




S.1-Baskakov | 












f 










ALANS 
MSAN 
ee m N 





e^ 







1 ye W^ A « 
NASA 
NS Nee ox 





S 
SAN. 
S 
SS 





NS 


n il 


A 
SSS 
SS 






Mir n. is 
Publishers . 
Moscow  . 











C.H. backakos 
PannuorexHHueckHe yenn 

M CHITHAJIBI 

«Bhaircuraa urkona» Mocksa 


Signals | 
and Circuits 


S.I.Baskakov 


Translated from the Russian 
b 


Boris V. Kuznetsov 





Kt AG 
il o 

o 
eS 70 


Mir Publishers Moscow 


First published 1986 
Revised from the 1983 Russian edition 


TO THE READER 


Mir Publishers welcome your comments on the content, translation, and design 
of the book. 

We would also be pleased to receive any suggestions you care to make about 
our future publications. 

Our address is: 

USSR, 129820, 

Moscow, I-110, GSP, 

Pervy Rizhsky Pereulok, 2. 

Mir Publishers 


Ha ax2auitckom A3biKe 


Printed in the Union of Soviet Socialist Republics 


H3nmaremzecrBo «Bbrcuras mkoa», 1983 
English translation, Mir Publishers, 1986 


Contents 


Preface 
Introduction 
Part One. Signals 
Chapter 1 Elements of the General Theory of Signals 
1.1 Classification of Signals 
1.2 Dynamic Representation of Signals 
1.3 Geometric Methods in Signal Theory 
1.4 The Theory of Orthogonal Signals 
Summary 
Review Questions 
Problems 
Advanced Problems 
Chapter 2 Spectral Representations of Signals 
2.1 Periodic Signals and Fourier Series 
2.2 Spectral Analysis of Nonperiodic Signals. 
The Fourier Transform 
2.3 Basic Properties of the Fourier Transform 
2.4 Spectra of Nonintegrable Signals 
2.5 The Laplace Transform 
2.6 Basic Properties of the Laplace Transform 
Summary 
Review Questions 
Problems 
Advanced Problems 
Chapter 3 Power Spectra of Signals. Principles of Correla- 
tion Analysis 
3.1 Cross-Spectral Density. Power Spectrum 
3.2 Correlation Analysis of Signals 
3.3 The Autocorrelation Function of Discrete Signals 
3.4 The Cross-Correlation Function of Two Signals 
Summary 
Review Questions 
Problems 
Advanced Problems 
Chapter 4 Modulated Signals 


41 Amplitude-Modulated Signals 
4.2 Angle Modulation 

4.3 Pulsed FM Signals 
Summary 

Review Questions 


100 
101 
102 


103 


103 
112 
122 
129 
129 


Chapter 5 


Chapter 6 


Chapter 7 


Part Two. 


Chapter 8 


Contents 


Problems 
Advanced Problems 


Band-Limited Signals 


5.1 Some Mathematical Models and Properties of 
Band-Limited Signals 

5.2 The Kotelnikov Theorem 

5.3 Narrowband Signals 

5.4 The Analytic Signal and the Hilbert Transform 

Summary 

Review Questions 

Problems 

Advanced Problems 


An Outline of the Theory of Random Signals 


6.1 Random Variables and Their Characteristics 

6.2 Statistical Characteristics of Two and More Ran- 
dom Variables 

6.3 Random Processes 

Summary 

Review Questions 

Problems 

Advanced Problems 


The Correlation Theory of Random Processes 


7.1 The Spectral Representation of Stationary Random 
Processes 

7.2 Differentiation and Integration of Random Pro- 
cesses 

7.3 Narrowband Random Processes 

Summary 

Review Questions 

Problems 

Advanced Problems 


Circuits 


Response of Linear Stationary Systems to De- 
terministic Signals 


8.1 Physical Systems and Their Mathematical Models 

8.2 The Impulse, Step and Frequency Responses of 
Linear Stationary Systems 

8.3 Linear Dynamic Systems 

8.4 Spectral (Frequency-Domain) Analysis 

8.5 The Operational Method 

Summary 


130 
131 


133 


133 
137 
143 
149 
158 
159 
160 
161 


162 
162 


170 
177 
185 
186 
187 
187 


189 


189 


196 
203 
215 
216 
217 
218 


219 


219 
219 


222 
230 
239 
248 
255 


Chapter 9 


Chapter 10 


Chapter 11 


Contents 


Review Questions 
Problems 
Advanced Problems 


Response of Frequency-Selective Systems to De- 
terministic Signals 


9.1 Models of Frequency-Selective Circuits 

9.2 Response of Frequency-Selective Circuits to Broad- 
band Excitations 

9.3 Response of Frequency-Selective Circuits to Nar- 
rowband Excitations 

Summary 

Review Questions 

Problems 

Advanced Problems 


Response of Linear Stationary Networks to 
Random Signals 


10.1 Spectral Analysis of the Response of Linear 
Stationary Circuits to Random Signals 

10.2 Sources of Fluctuation Noise in Circuit Com- 
ponents 

Summary 

Review Questions 

Problems 

Advanced Problems 


Signal Transformations in Nonlinear Circuits 


11.1 Lag-Free (Zero-Memory) Nonlinear Transforma- 
tions 

11.2 The Spectral Composition of the Current in a 
Zero-Memory Nonlinear Element Driven by a 
Harmonic Excitation 

11.3 Nonlinear Tuned Amplifiers and Frequency Mul- 
tipliers 

11.4 Lag-Free (Zero-Memory) Nonlinear Transforma- 
tions of a Sum of Harmonic Signals 

11.5 Amplitude Modulation. Detection of AM Signals 

11.6 Response of Lag-Free (Zero-Memory) Nonlinear 
Circuits to Stationary Random Signals 

Summary 

Review Questions 

Problems 

Advanced Problems 


256 
256 
258 


259 
259 


268 


274 
286 
287 
288 
289 


290 


290 


300 
309 
310 
310 
311 


313 


313 


318 


323 


326 
330 


337 
342 
343 
343 
344 


Contents 


Chapter 12 Signal Transformations in Linear Parametric 


Chapter 13 


Chapter 14 


Chapter 15 


Circuits 


12.1 Response of Resistive Parametric Circuits 

12.2 Energy and Power Relations in Reactive Para- 
metric Elements 

12.3 Principles of Parametric Amplification 

12.4 Nonstationary Dynamic Systems 

12.5 Response of Parametric Systems with Random 
Characteristics to Harmonic Signals 

Summary 

Review Questions 

Problems 

Advanced Problems 


A Basic Theory of Linear Circuit Synthesis 


13.1 Analytical Properties of the Driving-Point Impe- 
dance of a Passive Linear One-Port 

13.2 Synthesis of Passive One-Ports 

13.3 Frequency Characteristics of Two-Ports 

13.4 Low-Pass Filters 

13.5 Implementation of Filters 

Summary 

Review Questions 

Problems 

Advanced Problems 


Active Networks with Feedback. Self-Excited 
Oscillatory Systems 


14.1 The Transfer Function of a Linear Feedback 
System 

14.2 Stability of Feedback Networks 

14.3 Active RC Filters 

14.4 Self-Excited Harmonic Oscillators. The Small- 
Signal Condition 

14.5 Self-Excited Harmonic Oscillators. The Large- 
Signal Condition 

Summary 

Review Questions 

Problems 

Advanced Problems 


Discrete Signals. Principles of Digital Filtering 


15.1 Discrete Pulse Sequences 

15.2 Digitization of Periodic Signals 
15.3 The Theory of the z-Transform 
15.4 Digital Filters 


345 
345 


352 
358 
366 


372 
376 
377 
378 
378 


380 


380 
385 
391 
395 
401 
406 
407 
407 
408 


409 


409 
415 
420 


426 


435 
443 
444 
445 
447 


448 


448 
453 
458 
462 


Chapter 16 


Appendices 


Contents 


15.5 Implementation of Digital Filtering Algorithms 
15.6 Synthesis of Linear Digital Filters 

Summary 

Review Questions 

Problems 

Advanced Problems 


Optimum Linear Signal Filtering 


16.1 Optimum Linear Filtering of Known Signals 
16.2 Implementation of Matched Filters 

16.3 Optimum Filtering of Random Signals 
Summary 

Review Questions 

Problems 

Advanced Problems 


Bibliography 


Index 


468 
477 
484 
484 
485 
486 


487 


487 
493 
501 
504 
504 
505 
505 
506 
510 
512 


9 


Preface 


The present book is a course on signals and circuits as it is 
taught in the USSR. This subject figures prominently among the 
fundamental disciplines essential to the expertise of communication 
engineers. Keeping pace with overall progress in science and 
technology and reflecting the current trends in component design 
and theory, this course combines and sets forth in a systematic way 
the most important principles in the field of communications. 

In his work on the text, the author has been guided by the idea 
that material should be specifically tailored to the teaching practice 
at college. This approach has governed the selection of material and 
the degree of detail in its presentation: its pages contain what, as 
the author believes, the student can fully assimilate during the time 
allotted. Specific circuit types, their study and comparative 
analysis -all this belongs to the specialized subjects in 
communication engineering. 

This text includes a wide variety of material and a wealth of 
concepts and techniques which will come the student’s way for the 
first time. Ample space is devoted to mathematical tools of study. 
To link theory closer to practice, the chapters contain a great 
number of examples and problems giving the student deeper 
insight into the techniques of engineering analysis. 

Subject-matter and structure. The book is in two parts. Part One, 
Signals, introduces the reader to the methods currently used to 
describe and study the properties of signals. Among other things, it 
covers the classification of signals, the fundamental principle of the 
geometric treatment of the signal space, the spectral and correlation 
analysis of deterministic signals, the theory of modulated signals, 
and the discrete presentation of band-limited continuous signals. 
The methods used to analyse and measure the characteristics of 
random signals are discussed in detail. 

Part Two, Circuits, gives a systematic exposition of the principles 
underlying the analysis and determination of the response of linear 
and nonlinear circuits to both deterministic and random signals. 
Special emphasis is placed on the role of narrowband frequency- 
selective networks. Techniques are discussed that are used to 
synthesize linear two-terminal (one-port) and  four-terminal 
(two-port) networks having a predetermined frequency response, 
and consideration is given to the passage of signals through linear 
parametric circuits. In the pages devoted to nonlinear lag-free 
(zero-memory) circuits, the reader will learn about the most 
important forms of signal transformations, such as modulation, 
detection, multiplication, and frequency conversion. Material is 
included on the theory of harmonic self-excited oscillators and the 
more recent trends that have come into being only recently in the 
wake of advances in microelectronics. These include active filters 
for analog signals and, as a most promising technique, digital signal 
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filtering. Finally, elements of the theory of optimal linear filtering as 
applied to deterministic and random signals are discussed. 

When the reader opens the book, he will undoubtedly notice its 
makeup. In addition to the text in the body of a page, its margins 
display auxiliary, supplementary and graphical material. More 
specifically, the material on the margins includes. 

1. REMINDERS referring to the previous courses, such as 
physics and circuit theory. 

2. REFERENCE DATA, such as basic physical constants, 
tabulated integrals, and the like. 

3. SHORT NOTES which have as their objective to draw the 
reader’s attention to the relation existing among various subjects, 
the methods common to communication engineering and other, 
sometimes remote, fields of pure and applied science. 

4. AUXILIARY DRAWINGS which will not, as a rule, be 
referred to in the text, but are an integral part of the study material. 
Apart from helping reduce the size of the book, they give it, as far 
as practicable, the flavour of a live lecture. 

5. LABELS to help the reader organize his work on the book: 

Bj Here the text describes a principle of primary importance to 
communication theory and engineering. 

@ The reader is alerted to the fact that a new concept has been 
formulated and it must be memorized. 

A The reader is advised to work a problem from among those 
given at the back of the respective chapter; the problem illustrates 
some point (or points) set forth in the body of the text. 

Today the college student has to assimilate material at a high 
pace. That is why he must schedule his academic activity carefully. 
Wishing to help him in this matter, the author has taken special 
pains to grade the material offered for assimilation and 
recapitulation optimally. Each chapter corresponds to a major topic 
of the lecture course. The basic structural unit of a chapter is 
a section roughly corresponding to a complete lecture. 

At the back of each chapter there is a SUMMARY. A firm 
knowledge of the summaries is mandatory. There are also REVIEW 
QUESTIONS which will be especially useful to the student in 
preparation for his examinations. The PROBLEMS section covers 
material for the student’s work on his own and corresponds to 
the respective chapter and the degree of complexity. Each chapter 
includes ADVANCED PROBLEMS intended for students who 
have special interest in communication theory and tend towards 
research work. 

The book is based on the lectures that the author has been 
reading at the Radio Engineering Department of the Moscow 
Power Institute. The author wishes to express his deep gratitude to 
his colleagues, especially professor G.D. Lobov and Docent 
V.P. Zhukov for their unfailing support and valuable suggestions. 


Svyatoslav I. Baskakov 


Introduction 


Communication engineering is both a science and an art whose 
objectives are: 

(1) to study the principles underlying the generation, 
amplification, emission, and reception of electromagnetic waves 
falling within the radio-frequency (r.f.) range; 

(2) to put these waves to practical use for the purposes of 
transmitting, storing and converting information. 

In its early days, after A.S. Popov invented radio in 1895, 
telecommunication was mainly based on the use of wavelengths of 
several hundred or even thousand metres. Today, the field of 
telecommunications has expanded enormously. Radio 
communications, television, radio control, radar, and radio 
navigation are only a few of the many divisions of 
telecommunications. 

The science that has to do with the physical: principles of radio 
engineering is known as radio physics. It is a division of the applied 
natural sciences, closely related to the fundamental fields such as 
quantum mechanics, solid-state physics, to name but a few. 

Communication engineering in the USSR has been pushing in 
many directions, with fundamental contributions from 
Academicians L.I. Mandelshtam, N.D. Papalexi, V.A. Fok, 
A.I. Berg, V.A. Kotelnikov, and many other Soviet scientists. 

As the reader knows from previous courses, the transmission of 
a message from the source to the recepient involves the use of 
a communication channel. Basically, a communication channel 
consists of a transmitter, a receiver, and the physical medium 
through which the emitted electromagnetic waves are propagated. 
This medium may be a free space or an engineering structure, 
such as waveguides, cables, and other transmission lines. 

The signal coming from the originator at the sending end of 
a channel is converted by a microphone, a TV camera or other 
devices into electric oscillations. These oscillations cannot be used 
to excite electromagnetic waves in the medium directly because 
their frequency is too low. Therefore, the methods of signal 
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transmission used in communication are based on the fact that the 
low-frequency, or baseband, oscillations carrying the original 
message are utilized by suitable devices to vary the parameters of 
a sufficiently strong carrier whose frequency lies in the r.f. range. 
This form of signal transformation is called the modulation of the 
carrier. 

The modulated signal is radiated by the antenna of the 
transmitter. The resultant electromagnetic waves produce in the 
antenna of a receiver a signal, usually at a very low power level. 
After frequency filtering and amplification, the received signal is 
subjected to demodulation (or detection) which is the reverse of 
modulation, in order to extract the original baseband signal from 
the modulated one. As a result, the signal appearing at the 
receiver's output is an exact replica of the transmitted original 
message. 

From the above brief description of how a simple communication 
channel operates it is seen that the transmission of messages over 
the channel involves a variety of signal transformations. These 
transformations are implemented by appropriate physical systems 
known as (electric and electronic) circuits. Each circuit performs 
a particular transformation of the applied signal, and the nature of 
this transformation is wholly decided by the internal structure of 
the circuit. Accordingly, communication circuits are classed into 
amplifiers, — frequency-selective filtering systems, waveform 
converters, modulators, detectors, and many other types considered 
in this course. 

In any real communication channel, the wanted signal is always 
accompanied by interference arising from many factors, such as the 
noise created by the chaotic thermal motion of electrons in the 
circuit components, imperfect contacts in the apparatus, the effect 
of adjacent channels operating at closely spaced carrier frequencies, 
the presence of noise-producing cosmic rays, and the like. The 
ability of a communication system to transmit and receive 
information faithfully is known as noise immunity. The development 
of noise-immune systems is one of the principal tasks of present-day 
communication engineering. The theory and art of building such 
systems are the objectives of a separate division which has come to 
be known as statistical communication based on probabilistic 
methods. One of the most effective approaches to securing high 
noise immunity is the use of better forms of signal modulation, 
notably optimal message coding. 

To sum up, the course on signals and circuits will be concerned 
with the following subjects: 

1. The properties of various signals and interference and the 
principles underlying their mathematical description. 

2. The properties of the physical systems acting as 
communication circuits. 
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3. The methods for the analysis of signal transformation in 
circuits, and for the synthesis of the basic types of circuits. 

4. The synthesis of communication circuits having predetermined 
properties. 

To-day, communication engineering is a rapidly growing and 
developing field of applied science. Speaking of its prospects in the 
nearest future, mention should be made of the tendency towards using 
electromagnetic waves at ever higher frequencies. For example, 
microwave frequencies utilized at one time solely in radar have now 
come to be widely used in television and telemetry. Impressive 
successes have been scored in the development of laser 
communication systems using carrier frequencies lying in the visible 
and infra-red regions of the electromagnetic spectrum. 

Rapid progress has been registered in the field of circuit 
components and circuit design. Whereas traditional circuits are 
almost exclusively combinations of linear and nonlinear 
components, the more recent trend is towards the use of 
self-contained functional devices and systems which effect signal 
processing by virtue of the specific wave and oscillatory phenomena 
occurring in semiconductors, dielectrics and magnetics, that is, in 
the solid state. Microelectronic hardware, too, is playing an 
important role in present-day communication engineering. Readily 
available, reliable and lag-free, integrated circuits (ICs) have had an 
important impact on many fields of communication engineering. 
Microelectronics has been instrumental in the large-scale change- 
over to the fundamentally new digital methods of signal processing 
and transformation. 

There is every reason to believe that all branches of 
communication will keep expanding and advancing on the basis of 
progress in many allied fields of science and technology. 


l. Signals 


Chapter 1 


Elements of the General Theory 
of Signals 


The term signal is frequently encountered not only in science and 
technology, but also in everyday life. Without giving a second 
thought to the matter, we sometimes do not differentiate the 
concepts of signal, message, and information. Ordinarily, this does 
not entail any confusion because the word signal has its origin in 
the Latin signum (sign) which has a broad range of senses. Still, in 
getting down to a systematic study of communication theory, we 
should refine the meaning of the concept of signal. By tradition, the 
term signal refers to time variations in the physical state of an 
object which serves to represent, register and transmit messages. In 
man’s activities, messages are inseparably related to the information 
they carry. 

The range of problems involving the concepts of message and 
information is very broad. They have long been drawing close 
attention from engineers, mathematicians, linguists, and philoso- 
phers. In the 1940s, C. Shannon laid the foundation for a new 
direction in science which has come to be known as information 
theory. 

The problems that information theory has to do with usually lie 
far outside the scope of a course on signals and circuits. Therefore, 
this book will not dwell upon the relation between the physical 
form of the signal and the meaning of the message embedded in it. 
Nor will it discuss the value of the information embodied in 
a message and, in the final analysis, in a signal. 


1.1 Classification of Signals 


When one embarks on a study of some new objects or 
phenomena, one always strives to classify them in some preliminary 
manner. At this stage, our principal objective is to formulate 
criteria under which signals may be classified, and, which is very 
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important for the subsequent discourse, to define applicable terms. 

A signal and its mathematical model.Signals as certain physical 
processes can be observed with a variety of devices and 
instruments, such as cathode-ray oscilloscopes, voltmeters, and 
receivers. This empirical approach suffers from a serious limitation. 
The phenomena examined by an experimenter always manifest 
themselves as specific, individual events which lack the degree of 
generality that could enable the experimenter to form an idea about 
their fundamental properties and to predict results under changed 
conditions. 

For signals to serve as objects of a theoretical study and 
calculations, it is essential to tell how they can be described 
mathematically or, in scientific parlance, to build a mathematical 
model of the signal under study. 

A mathematical model of a signal is a functional relation in 
which the argument (or independent variable) is time. As a rule, we 
shall designate mathematical models of signals with letters of the 
English alphabet, as follows: s(t), u(t), f(t), and so on. 

The choice of a model is the first important step towards 
a systematic study of a phenomenon (in our case, a physical signal). 
Above all, a mathematical model enables the investigator to divorce 
himself from the specific nature of the signal carrier. In 
communication engineering, one and the same mathematical model 
can equally well describe current, voltage, electric field strength, and 
other quantities. 

Another aspect of the method based on mathematical modelling 
is that the investigator can limit himself solely to those of the 
properties of signals that are objectively most important and 
neglect a large number of secondary attributes of minor 
importance. For example, it would be extremely difficult in an 
overwhelming majority of cases to find exact functional relations 
which would fit the electric oscillations as they are observed 
experimentally. Yet, proceeding from what he knows about the 
system as a whole, the investigator can draw upon the multiplicity 
of mathematical models available to him and select one best suited 
to each particular case and possessing a maximum of simplicity. 
Thus, the choice of a model is in a sense a creative process. 

The functions describing signals can take on real and complex 
values. Quite aptly, in our discussion we shall frequently mention 
real and complex models of signals. Which to use is solely a matter 
of mathematical convenience. 

Mathematical models of signals enable the investigator to 
compare them, to establish their similarity or difference, and, in the 
final analysis, to classify them. 

One-dimensional and multidimensional signals. A typical 
communication signal is the voltage across the terminals of a circuit 
or the current flowing in that circuit. Such a signal can be described 
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by one time function, so it is called a one-dimensional signal. In this 
text, we will be mostly concerned with one-dimensional signals. 
Sometimes, however, it will be convenient to consider 
multidimensional (or vector) signals of the form 


V(t) = [v, (0, v; (t) ..., vn ()] 


formed by a set of one-dimensional signals. The number N is the 
dimensionality of a multidimensional signal. (The term 
dimensionality has been borrowed from linear algebra.) 

An example of a multidimensional signal is the set of voltages 
existing at the terminals of a multiport. 

Importantly, a multidimensional signal is an ordered set of 
one-dimensional signals. Therefore, signals differing in the sequence 
in which their components occur will not, in the general case, be 
identical: 


{vi v2} A {v2, 04} 


The use of multidimensional signal models is especially 
warranted in cases where a complex system is being analyzed on 
a computer. 

Deterministic and random signals. Alternatively, signals may be 
classified according as their instantaneous values can or cannot be 
predicted accurately at any instant of time. If the mathematical 
model of a signal permits this prediction, we have a deterministic 
signal. It can be specified in a variety of ways: by giving 
a mathematical formula, a computational algorithm, or simply its 
description in words. 

Strictly speaking, deterministic signals are nonexistent in nature. 
The inevitable and unpredictable interaction of the message source 
with surrounding physical objects and the chaotic thermal fluc- 
tuations bring us to consider real signals as random or stochastic 
time functions, that is, to deal with random or stochastic signals. 

In telecommunications, random oscillations frequently manifest 
themselves as noise interfering with the extraction of the valid 
information from the received oscillation. That is why the search 
for ways and means of controlling interference and improving the 
noise immunity of reception are pivotal problems in present-day 
communication engineering. 

It may appear that the concept of random signal is contradictory. 
This is not so, however. For example, the signal appearing at the 
receiver output of a radio telescope trained on a source of cosmic 
radiation is composed of random fluctuations, but they carry 
variegated information about the natural object. 

No hard and fast boundary exists between deterministic and 
random signals. Quite frequently, especially when the noise level is 
substantially lower than that of the wanted signal of known form, 
a simpler deterministic model may prove adequate. 
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(a) 





Fig. 1.1 Pulse signals and their characteristics: (a) video pulse; (b) radio 
pulse; (c) numerical parameters of a pulse 


The techniques and procedures of statistical communication 
theory developed in recent decades to analyse the properties of 
random signals have quite a number of specific features and are 
based on the mathematical tools of probability theory and the 
theory of random processes. All this will take up the whole of 
Chapters 6 and 7. 

Pulse signals. Pulses are a very important class of signals for 
telecommunications. By definition, a pulse is an oscillation which 
exists only within a finite span of time. It is customary to 
distinguish video pulses (Fig. 1.1a) and radio pulses (Fig. 1.1b). They 
differ in the following. If uy(t) is a video pulse, then the 
corresponding radio pulse will be 


u,(t) = uy(t) cos (Oot + o) 


where the frequency @, and the initial phase «y are arbitrary. In 
the above expression, uy(t) is the envelope of the radio pulse and the 
function cos (ost + Qo) is called the carrier. 

Often, especially in engineering calculations, the complete 
mathematical model which accounts for all details in the "fine 
structure" of a pulse is replaced with the numerical parameters of 
the video pulse which give a simplified idea about its form. Thus, 
for a video pulse approaching a trapezoid in shape (Fig. 1.1c), it is 
convenient to know its amplitude (or height) A. Of the time 
parameters of a video pulse, its duration, tp, is the most important 
one. Frequently, it is also important to know the rise time, t;, and 
the fall (or decay) time, tf, of a pulse. 

Communication engineering has to do with voitage pulses with 
amplitudes ranging from a few fractions of a microvolt to several 
kilovolts and with a duration of down to a few nanoseconds. 

Continuous, discrete and digital signals. Before we conclude the 
brief overview of the principles underlying the classification of 
signals, the following should be noted. 

Usually, any signal-producing physical process develops in time 
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in such a way that the signal value can be measured at any instant. 
Signals of this class are known as continuous. Another name is 
analog signals. The term analog is used since the waveform of the 
signal is analogous, or similar, to the input process waveform. 

A one-dimensional continuous signal can be represented by its 
waveform (such as recorded on an oscillograph), which may be 
likewise continuous or discontinuous. 

In the early days of communication services only continuous 
signals were used. Owing to their properties, they served well quite 
a number of tasks (radio communication, television, etc.). Also, 
continuous signals were simple to generate, receive and process by 
the facilities available at that time. 

As the requirements to be met by communication systems grew 
more stringent and the systems were called upon to perform an 
ever increasing number of tasks, the need arose to look for new 
design principles. In some cases, analog systems have given way to 
sampled-data (pulsed) systems which utilize signals produced by 
sampling. The simplest mathematical model of a sampled (discrete) 
signal, sq(t), is a countable set of points (tj) (where i= 1, 2, 3, ...) 
along the time axis, at each of which a sample, s;, of the signal is 
determined. As a rule, the sampling interval, A = t; 4, — tj, is 
constant for a given signal. 

An advantage which discrete (sampled) signals have over 
continuous signals is that there is no need for reproducing the 
signal continuously, at every instant along the time axis. Owing to 
this feature, one and the same communication system may be used 
to transmit messages from different sources to different users by 
means of what is known as time division multiplexing (TDM). 

Obviously, in order to derive a sampled waveform from 
a continuous signal which'rapidly varies in time a shorter sampling 
interval A is required. This fundamental matter will be taken up in 
more detail in Chapter 5. 

Discrete signals include a special variety known as digital signals. 
They are called "digital" because their samples are represented by 
numbers (digits) For ease of engineering implementation and signal 
processing, binary numbers are used, with a limited and, as a rule, 
not very large number of digits or bits. Recently, there has been 
a growing trend towards using digital (sampled-data) systems on an 
ever wider scale. It has been stimulated by advances in 
microelectronics and integrated circuits. 

It is important to remember that any discrete or digital signal 
(we mean a physical process rather than its mathematical model) is 
essentially a continuous signal For example, a slowly varying 
continuous signal, s(t), can be represented in a discrete (sampled) 
form as a sequence of rectangular video pulses of equal duration 
(Fig. 12a); the samples have amplitudes proportional to that of s(t) 
at sampling points. Or we may proceed in a different way: we can 





The model of a samp- 
led (discrete) signal 


101110010 
010011000 
100110011 


Consecutive samples of 
a digital signal 
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s(t) S(t) 


(a) (5) 


Fig. 1.2 Sampling of an analog signal: (a) with samples varying in height; 
(b) with samples varying in width (length) 


hold the amplitude of the pulses at a constant value and vary their 
duration in proportion to the sample values (Fig. 1.25). 

What is important is that the two methods of converting 
a continuous signal into a sampled (discrete) signal are completely 
equivalent if we assume that the values of the continuous signal at 
the sampling points are proportional to the area of the individual 
video pulses. 

In digital form, too, samples can be represented as a sequence of 
video pulses. The binary number system ideally suits the purpose. 
We may, for example, assign a high potential level to a 1, and a low 
potential level to a 0. 

In more detail, discrete (sampled) signals and their properties will 
be studied in Chapter 15. 


1.2 Dynamic Representation of Signals 


Many tasks in telecommunications call for specific signal 
representations. Frequently it is essential to know not only the 
instantaneous (present) value of a signal, but also its behaviour 
along the time axis both in the past and in the future. 

The principle of dynamic representation. Let us describe a real 
signal approximately, using a sum of elementary signals occurring 
at consecutive instants of time. By letting the duration of the 
individual elementary signals tend to zero, we shall, naturally, have 
an exact replica of the original signal in the limit. This is the 
dynamic representation of signals; the word “dynamic” emphasizes 
the fact that the process is varying in time. 

Elementary signals may be chosen in any arbitrary manner, but 
two methods of dynamic representation are in a specially wide use. 
In one of them, elementary signals are step functions occurring at 
equal time intervals, A (Fig. 1.3a). The height of each step is equal 
to the change in the signal over the time interval A. In the other 
method, elementary signals are rectangular pulses. They are 
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(5) 


Fig. 1.3 Dynamic representation of signals. (The arrows indicate the 
direction of variation in the elementary components with time.) 


contiguous to each other so that they form a sequence inscribed 
into or circumscribed around a curve (Fig. 1.35). 1.0 v(t) 
Let us take a closer look at the properties of the elementary | 
signal used in the first method of dynamic representation. 0.5 | 
Switching function.Suppose the mathematical model of the | 
signal is a set of equalities l t 
0, t<—-€ $ $ 
ut) 240.5(t/5--1) —6<t<6 (1.1) 
T, L6 


The function (1.1) describes the transition of a physical object 
from a "zero" to a “one” state, so that the transition is linear over & 
the time interval 2%. If we let € tend to zero, then in the limit the The switching or Hea- 
transition will occur instantaneously. The mathematical model of  viside function 
this limiting signal has come to be known as the switching function 
or the Heaviside function: 


( 0  r«0 Oliver Heaviside 
o(t) =< 0.5, 1-0 (1.2) (1850-1925), a British 
l l t>0 physicist 


Using the function c(t), it is convenient to describe various 
switching processes in electric circuits. 

In the general case, the switching function may be translated 
from the origin of time by an amount tọ. The translated (or time- 
shifted) switching function is written as 


Un 
0, $< to 1.0 
o(t— ta) =< 05, t=tọ (1.3) T 
1, t Íg 
t 
The way the switching function is defined above is not the only 0 


one possible. As an example, which can readily be checked, the 
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functions that form the sequence 
un(t) = 1/[1 + exp( — nt)] 


approximate a discontinuous signal undergoing a jump of unity at 
t — 0 ever more accurately with increasing number n. 

In communication theory, switching functions are widely used to 
describe discontinuous, notably pulse, signals. 





Example 1.1. Let there be a rectangular pulse signal v with 
a duration of 5 us and an amplitude of 15 V. The origin of time 
coincides with the leading edge of the pulse. Write an analytical 
expression for this signal. 

The jump in level at t=0 is described by the function 


v=15o0(t) 


For the pulse to cease at t=5x10~°s, we should subtract 
a similar switching pulse delayed by this time interval so that 


v(t) = 150 (t) — 156(t — 5 x 1076) V 


Example 1.2. A source of an emf linearly varying with time as 
e(t) =3.0 x 10°t V, is connected to an external circuit by a perfect 
switch closing at time ty — 2 us. Write a mathematical model for the 
output voltage of the system. 

For times shorter than 2 us, the output voltage of the source is 
zero. Therefore, it is obvious that 


v(t) 2 3.0 x 108t x o(t—2 x 107 5)V 


y, V 
t=2ps 12 
—— J 9 
e(t) | vo 6 
3 
n 
t,us 
0 2 4 6 


The above process may be written differently, if we represent it as 
the sum of the switching pulse occurring at the instant when the 
switch closes and a linearly rising pulse: 


v(t)=[6+3 x 106(t— 2 x 107 ®)Ja(t-2x 10 9) V 


1S 





0 2.5 5.0 7.5 10 


A 
Work Problems 1 and 
2 





Dynamic representation of an arbitrary signal in terms of 


switching functions. Consider a signal s(t), assuming that s(t) — 0 at 
t « 0. Let (A, 2A, 3A, ...} be a sequence of time instants and {Sis 52. 
S3, ...] be the corresponding sequence of signal values. If sọ = s(0) 
is the zeroth sample value, then, as follows from the plot, the value 
of the signal at any t is approximately equal to the sum of step 
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functions 
s(t) X soo (t) + (s, — sg)o(t — A) + (s2 — Sy) (t — 2A) + ... 





= soo (D + Y. (sk— si.) 0 (t — kA) 
k=1 

If, now, we let the sampling interval A tend to zero, the discrete A 24 3A 
variable kA may be replaced with a continuous variable t. The 
small changes (s,—s,_,) may be replaced by differentials ds = 
= (ds/dt)dt, and we arrive at a dynamic representation of an 
arbitrary signal in the form 


s(t) = Spo (t) + f (ds/d1) o (t —t)dt (1.4) 








Example 1.3. The signal s(t) is equal to zero at t <0 and varies as 
a quadratic parabola, s(t)=At?, at t0. Find the dynamic 
representation of this signal. 

Here, sọ — 0, and ds/dt = 24:1. Therefore, 


s(t) - 2A f 16 (t — t)dt 
0 


The meaning of the last equation is that the height of the 
elementary steps that form the aggregate signal linearly rises with 
time. 


In passing to the second method of dynamic representation of 
signals, when the expansion elements are short pulses, we 
should introduce a new important concept. 

Delta-function. Consider a rectangular pulse signal defined by the 
formula 


v(t; 5$) = (1/6) [ot + 5/2) - o (t  £/2)] (1.5) id 1/& 


This pulse is characterized by the fact that with any choice of the 
parameter € it has unit area: 


Á= [ vdt=1 
=% 
If, for example, v is a voltage, then A,=1 V s. 
Now we let the parameter Ẹ tend to zero. While contracting in t 
duration, the pulse retains its unit area. Therefore, its height must -4/2 0 &/2 


increase without bound. The limit of a sequence of such functions 
as £ 2 0 is termed the unit impulse function, the delta function, or the 
Dirac delta-function: 

8(t) = lim v(t; &) (1.6) 


£20 
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The delta function in 
symbolic representa- 
tion 
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The delta function is a very interesting mathematical entity. 
Being equal to zero everywhere except at the point t =0 (it is said 
to be concentrated at that point), this function does possess a unit 
integral 


f 6(t)dt=1 (1.7) 


From a mathematical point of view, the Dirac delta-function is 
a generalized function. At present, the theory of generalized 
functions has gained a broad field of application. In many divisions 
of science, it has been used to study discontinuous processes that 
cannot be analysed by classical methods. 

In this course, we shall widely use the concept of the Dirac delta- 
function. The main reason for the popularity of the delta function is 
this. As will be recalled from mechanics, if a variable force F (t) acts 
on a material point of mass m over a time interval [t,, t3], the 
change in the momentum of the point will be given by 


t2 
mv, mv, = Í F (t) dt 
ti 


Thus, what counts is not the force itself, but its momentum appearing 
on the right-hand side of the above equation. The delta-function is 
just the mathematical model of a short input or stimulus of unit 
momentum (unit area). 

It is proved in mathematics that the properties of the delta 
function are inherent in many sequences of ordinary classical 
functions. We shall cite two typical examples [1]: 


8(t) = lim |/n/2n exp ( — nt? /2) (1.8) 


n- x 


6(t) = lim (sin nt)/nt (1.9) 

Dynamic representation of signals in terms of delta functions. Let 
us go back to the description of a continuous signal as a sum of 
contiguous rectangular pulses (see Fig. 1.35). If sj is the kth sample 
of the signal, then the kth elementary pulse may be defined by the 
equation 


x(t) = sk[o(t — t) — © (t — tk — A)] (1.10) 


Under dynamic representation, the original signal s(t) must be 
regarded as the sum of such elementary components: 


s(t)= Y nx(t) (1.11) 
k=-@ 
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At any t other than zero, this sum will contain only one kth term 
such that 


ty E EX fei 

On dividing and multiplying by the interval A, and substituting 
(1.10) into (1.11), we get 
s= Y, sk/A)[o(t — ti) ~ o (t — tk — A)]A 

k2-—« 

In the limit A—0, we must replace summation with integration 
with respect to the formal variable t whose differential, dt, is 
analogous to A. Since 
lim [8(t — 1) — o (t - x — AJ]/A = 9(t — 1), 


A0 
we obtain the sought-for formula for the dynamic representation of 


the signal 
s()= f sölt- 9d: (1.12) 


An important property of the delta function is that its physical 
dimensions are those of frequency. 

To sum up, if we multiply a continuous function by the delta 
function and integrate the product with respect to time, the result 
will be the value of the continuous function at the point where the 
&-impulse is concentrated. In this lies, as is customary to say, the 
filtering property of the delta-function. 

Among other things, hence arises the structure of a system for 
measuring the instantanequs values of a signal s(t) The system 
must consist of two units, a multiplier and an integrator. Clearly, 
the accuracy with which the value s(t9) is determined will improve 
as the real signal (say, a rectangular video pulse) approximately 
representing the delta function becomes shorter. 


1.3 Geometric Methods in Signal Theory 


Many theoretical and applied problems of telecommunications 
involve questions like these: (1) In what sense may we say that one 
signal substantially exceeds another? (2) Is it possible to evaluate 
objectively how much two different signals “resemble” each other? 

In the 20th century, mathematics has developed powerful techni- 
ques of functional analysis which generalize our intuitive ideas 
about the geometrical structure of space. As has been found, the 
concepts of functional analysis make it possible to formulate 
a consistent signal theory based on the treatment of a signal as 
a vector in a suitably constructed infinite-dimensional space. 
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Linear signal space. Let 
M = {s,(t), s; (t), ...] 


be a set of signals. The reason why these objects are combined is 
that each has properties common to all elements of the set M. 





Example 1.4. M is the set of all continuous signals which are 
nonzero in the time interval [0, 15 us] and equal to zero outside 


that interval. 


Example 1.5. M is a set of signals of the form 


sj(t) = Aj cos (wt + qj) 


which are harmonic oscillations differing in amplitude, frequency and 


initial phase. 


The structure of a 
linear space 





The properties of the signals that form a set can be investigated if 
it is possible to establish the relationship between the individual 
members of that set. Then, as is customary to say, the set possesses 
a definite structure. The choice of a particular structure for a set is 
dictated by physical considerations. For example, in the case of 
electric signals it is known that they can be combined and 
multiplied by an arbitrary scale factor. On this basis, we may use 
for such sets a structure known as a linear space. 

For a signal set M to form a real linear space, the following 
conditions (axioms) must be satisfied: 

1. Any signal u which is an element of the set M, that is, ueM, 
takes only real values for any t. 

2. For any ueM and veM there exists their sum 


w=u+v 


such that w also belongs to M, and the addition is both 
commutative 


utov=vt+u 
and associative 
ut+(v+x)=(utv)+x 


3. For any signal seM and any real number g, there is a signal 
which is defined as 


f= aseM 


4. The set M contains a unique member @ (called the origin) 
such that u+ Ø =u for each ueM. 

If we consider the mathematical models of signais taking on 
complex values and assume that in axiom (3) the multiplication is 
by a complex number, we shall arrive at the concept of a complex 
linear space. 

The introduction of the linear space structure is the first step 
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towards the geometric treatment of signals. The elements of linear 
spaces are frequently called vectors in order to stress their analogy 
in properties with conventional three-dimensional vectors. 

The constraints imposed by the axioms are very rigorous. In no 
way can just any set of signals be a linear space. 
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Example 1.6 The set M is formed by rectangular voltage video 
pulses existing in the time interval [0, 20 us], their amplitudes not 
exceeding 10 V. May this set be taken to be a linear space? 

If we add together pulses of amplitudes 6 V and 8 V, we will 
obtain a pulse which does not exist in the set M. Hence, M does 


not form a linear space. 


The concept of a basis. As with a conventional three-dimensional 
space, a linear signal space may be given a special structure which 
plays the role of a coordinate system. It is then said that the set of 
vectors Íe,, e5, €3, ...} belonging to M serves as a linearly 
independent basis for M, if the equality 


Y niei = Ø (1.13) 


i 
is satisfied only when the numerical coefficients o; vanish all at one 
and the same time. 

If we have an expansion of a signal s(t) in the form 


s(t-— b Cili 


P 
then the numbers {c,, c2, ...} are projections of the signal s(t) 
relative to the adopted basis. 
In signal theory, the mumber of basis vectors is, as a rule, 
infinitely large. Such linear spaces are called infinite-dimensional. 





e 
Linear independence 








Example 1.7. If a linear space is formed by signals which are 
described by polynomials of any order, however high: 


s(t)= 3 But” 
n=0 


(such functions are called analytic), then the basis for this space is 


a system of monomials 


lage doe, etes ti} 





À normed linear space. Signal energy. For further insight into the 
geometric treatment of signal theory, we need one more concept 
which would correspond in meaning to the length of a vector. With 
it, we cannot only give a more exact meaning to a statement such 
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e 
The norm of a signal 


e 
The energy of a signal 


If a signal represents 
a voltage, the units of 
signal energy are V^ s 
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as "The first signal is larger than the second one", but also state by 
how much it is larger. 

In mathematics, the analogue of a vectors length is its norm. 
A linear signal space Lis said to be normed, if to each vector s(t)eL 
is assigned a unique real number | s|. This number is called the 
norm of a vector; it satisfies the following axioms of a normed 
space: 

1. The norm is non-negative, that is, | s || >0, with | s || 20 if 
and only if s = Ø. 

2. For any number « the equality 
|| &s || =|e|- s| 
is satisfied. 

3. If s(t) and p(t) are two vectors out of the set L, the triangle 
inequality 
Is+pll<isi+lpl 
is satisfied. 

The norm of a signal may be defined in more than one way. In 


communication theory, it is most often assumed that real signals 
have the norm 


Isi- |/ f soa (114) 


— oc 


(of two likely values of the root, we choose the positive one) For 
complex signals 


iil -|/ f ss*dt (1.15) 


where s* is the complex conjugate of s. 
The square of the norm is termed the signal energy: 


E,-|2I?- f s*(9dt (116) 


Exactly this amount of energy will be dissipated in a 1-Q resistor if 
s(t) is the voltage applied across its terminals. 


Example 1.8. Find the energy and norm of the signal s(t) which is 
a triangular voltage pulse of height V and of duration Tp. s 


In the time interval [0, tp], the signal is described by the function 


s(t) = Vt/ty 


The energy of the signal is 





Ch. 1 Elements of the General Theory of Signals 29 
tp 
Es = (V?/1}) f t? dt = Y^u/3 
0 


The norm of the signal is 
I $1 2 VEs— Vy zp/ V/3 
Example 1.9. Find the energy of a radio pulse with a rectangular 


envelope. The pulse exists on the time interval [0, tp] and is 
described by the function 


S(t) = Vo cos (Wot + Po) : 
According to Eq. (1.16), 


MoT, + Qo 


ta 
Es — V$ f cos? (oot + ogg) dt = (Vo/og) | | cos?mdm 
0 


0 
= (V2/4o9) [2 (G1 + Po) + sin 2(o5tp + Po)] 


If the pulse duration is many times the period of the carrier fre- 
quency, that is, if @ tp > 1, then 


Es Vexp/2 
irrespective of the values of oy and q,. 





It is convenient to determine the norm of a signal by Eq. (1.15) 


for the following reasons. 


1. In communication engineering it is customary to state the 


magnitude of a signal in terms of the overall power effect, for 
example, the quantity of heat dissipated in a resistor. t 


2. The energy norm thus introduced is “insensitive” to variations 


in the signal waveform, which may be substantial, but occurring over 
relatively short spans of time. 


The normed linear space in which all vectors have a finite norm 
is termed the square-integrable function space and is symbolized as 
Lb. 

Metric space. Let us introduce one more fundamental concept 





which will generalize our idea about the distance between points in These signals only 


space. 
It is customary to say that a linear space L becomes metric, if to 


slightly differ in energy 


each pair of elements belonging to that space, u, veL, is assigned 

a real positive number p(u, v), called the metric, or the distance @ 
between those elements. Whatever the method used to define it, the The metric 
metric must obey the axioms of a metric space: 


1. p(u, v) 2 p (v, u) (reflexivity of the metric). 
2. p(u, v) 2 0 for any ueL. 
3. Whatever the element weL, it is always that 


p (u, v) < p(u, w) + p(w, v) 
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Ordinarily, the metric is defined as the norm of the difference 


between two signals: 


p(y, v) = |u— vll 


(1.17) 


In turn, the norm may be construed as the distance between 
a selected element of the space and the null element or the origin: 


lul = po Ø) 


By drawing upon the concept of metric, we can, for example, say 
how well one of the signals approximates the other. 


Example 1.10. The signal u(t) is a chopped sinusoid falling to zero 
at the ends of the interval [0, T]. The pulse height U is known. Find 
the amplitude A of a rectangular pulse v(t) of the same duration, such 
that the distance between the two signals is a minimum. 

The signal u(t) is defined by the formula 


u(t) = U sin (nt/T), 0<t<T 
The square of the distance between the signals is 
T 


p? (u, v) = f [U sin (xt/T) — A]? dt = U? T2 — 4AU Tx. + A?T 
0 


A test of the above expression for an extremum shows that the 
distance will be a minimum if 


A=2U/n = 0.637U 
Then, 
Phin = U?T(1/2 — 4/n?) x; 0.095U?T 
Pmin 2: 0.308U |/T 
It is to be noted that the energy of the sinewave pulse is 


T 
E, — U?| sin? (nt/T) dt = U?T/2 
0 


and its norm is 


lu] x 0707Uy/T 


Thus, in terms of the metric we have chosen, the minimal 
attainable distance between the signals in question is 44% of the 
norm of the sinewave signal. 


1.4 The Theory of Orthogonal Signals 





A 
Work Problem 9 


Although we have introduced the linear space structure in 
a signal set, and defined the norm and the metric, we are still not 
able to find an important characteristic—the angle between two 
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vectors. This can be done, if we introduce the concept of the scalar 
product between the elements of a linear space. 

Scalar product of signals. As will be recalled, if in a conventional 
three-dimensional space we know two vectors, A and B, the square 
of the modulus of their sum is 


|A+B/?=|A|? +|B/? + 2(AB) (1.18) 
where 
(AB) =| À |-| B| cos y 


is the scalar product of these vectors, dependent on the angle 
y between them. 

By analogy, we can find the energy of the sum of two signals, 
u and v: 


Exy= f (u + vo! dt = E, + E,+2 f uv dt (1.19) 


In contrast to the signals themselves, their energies are 
nonadditive—the energy of the aggregate signal contains what is 
called the cross energy 


Ey —2 f wdt 


From comparison of Eqs. (1.18) and (1.19), we can define the 
scalar product of the signals u and v as 





(u, v) = í u(t)v(t) dt . (1.20) 


— 00 





The cosine of the angle between them is 


(u, v) 
wo 1.21 
enem TTT we 


A scalar product possesses the following obvious properties: 
(1) (u, v) 20; 


(2) (u, v) — (v, u); 
(3) (Au, v) 2 (u, v), where X is a number; (1.22) 


(4) (u v, w) — (u, w) t (v, w). 


The linear space containing the scalar product defined in Eq. 
(1.20) and satisfying the conditions (1.22) is called the real Hilbert 
space, H. 

It is proved in mathematics that the Hilbert space satisfies the 


e 
The cross energy 


e 
The scalar product 


e 
The Hilbert space 
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David Hilbert (1862- 


1943), a prominent 
German  mathemati- 
cian 
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fundamental Cauchy-Buniakovski inequality 


|(u, v| < llull- |l (1.23) 


If the signals take on complex values, we may define a complex 
Hilbert space by introducing the scalar product according to the 


equation 
oo 
(u, v)- f u(0v*(0dt (1.24) 
— o0 
Example 1.11. T'here are two exponential voltage pulses (measured 
in volts, V) translated in time relative to each other and defined as 
follows: 
v, (t) = 5exp( — 1052 a(t) E H 
v,(t) = Sexp[ — 10? (t -2 x 107 9]o(r —2 x 1075) 
: t,ps 


Find the scalar product of the signals and the angle between them. 0 


The two signals have the same energy: 


oo 
lvi ||? = | v2 ||? = 25 f exp( —2 x 10°2)dt 
0 


—125x10 *V?s 


Their scalar product is 


oO 


(04,72) = 25 f exp( — 10°t)exp[ — 10^ (t +2 x 10 7 5)]dt 
0 


= 1.023 x 107 ^ V?s 


Hence, 

COS Yo v, = 0.819 
and 

lode 


G 
The principle of ortho- 


gonality 


Orthogonal signals and generalized Fourier series. Two signals, 
u and v, are called orthogonal if their scalar product and, in 
consequence, their cross energy are zero: 

oC 


(u, v)= f u(t)v(t)dt=0 


— 00 


(1.25) 


Figuratively speaking, orthogonal signals “do not look alike" as 
any pair of signals could. 
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Let H be a finite-energy signal Hilbert space. The signals are 
defined over a time interval [t,, t;], which may be finite or infinite. 
Suppose that over the same time interval we define an infinite 
system of functions {u}, uz, ..., Un, ...] which are pairwise mutually 
orthogonal and have unit norm: 


(u)- 1! Til (1.26 
uju) = . 
dic 0 ifizj | 
It is then said that an orthonormal basis is specified in the signal 
space. 

Let us expand an arbitrary signal s(t)eH into a series: 


s(t) = by ciui(t) (1.27) 


The representation in (1.27) is called a generalized Fourier series 
of the signal s(t) in the selected basis. 

The coefficients of this series are found as follows. We multiply 
both sides of the equality (1.27) by an arbitrary kth basis function, 
uy and integrate the results with respect to the time interval over 
which the signals are defined: 
ta X t 


[s(Qux()dt— F ci ( uiuxdt (1.28) 
t i21 ¢, 

Since the basis has the property of orthonormality, the right- 
hand side of (1.28) retains only one, kth, element of the sum. 
Therefore, . 





Ck= (sui) dt — (s, ux) (1.29) 


That a signal can be represented in terms of a generalized 
Fourier series is a fundamentally important factor. Rather than 
study a functional relationship at an uncountable set of points, we 
can characterize this signal with a countable (although, generally 
speaking, infinite) system of coefficients of a generalized Fourier 
series, cx, which are projections of the vector s(t) in a Hilbert space 
onto the basis directions. 

Examples of orthonormal bases. How infinite systems of mutually 
orthogonal functions can be constructed is examined in detail in 
mathematics (see, for example, [2]. Here, we shall only give as 
examples two of the most important and commonly encountered 
cases. 
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An orthogonal set of harmonic signals. The reader can prove him- 
self that over the interval [0, T] a set of trigonometric functions of 
multiple frequencies, extended to include a time-invariant signal: 


Ho = 1//T 
u, = V 2/Tsin 2nt/T 


i= /2/Tcos 2nt/T (1.30) 


disi V2/Tsin 2nmt/T 
lis V2/ Tcos 2nmt/T 


constitutes an orthonormal basis. 

The expansion of periodic functions into a series in terms of the 
above basis will be taken up in the next chapter. 

Walsh functions. In recent time, advances in the processing of 
discrete signals have given impetus to the use of orthonormal 
Walsh functions. A distinction of these functions is that over the 
interval of their existence, [ — T/2, 7/2], they take on only two 
values (+1 and — 1) which, as is seen, differ solely in sign. 

Let us introduce a dimensionless time 9 — t/T and designate the 
kth Walsh function by the symbol wal (k, 9). These functions are far 
more difficult to specify analytically (see Appendix 1). The basic 
idea, however, can readily be gleaned from Fig. 1.4 which shows 
plots of the first few Walsh functions. 

Interestingly, the kth Walsh function has the number k of zero 
crossings (sign changes) over the existence interval. 


| wal(0,9) wal (2,9) 


wal (1,9) 





+1 





Fig. 1.4 Plots of the first few Walsh functions 
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Obviously, the condition of normality for Walsh functions for 
any value of k is A 
1/2 Solve Problem 11 
|walk, 9)|?= f wal?(k, $)d9=1 
—1/2 
The orthogonality of these functions 1s assured by the principle of 
construction and can be verified directly. For example, 


1/2 -1/4 
f wal(1, 9)wal(2, 8)d8— J (-1Pd8 
-1/2 =Z 

4 1/2 


0 1/ 
+ f (-1)x1d9+ f 1°d9+ f1x(-1d9=0 
1/4 1/4 


0 
The expansion of a finite-energy signal defined over the time 


interval [ — 7/2, 7/2] into a generalized Fourier series in terms of 
Walsh functions, has the form 


s(9)= Y exwal(k, 9); 9=t/T (1.31) 
k=0 





Example 1.12. Find the first two coefficients in the expansion of 
a triangular pulse in terms of Walsh functions. 

Over the time interval [ — 7/2, 7/2], the signal is described by 
a function of the form 


s(t) — U (t/T+ 1/2) 


d U The coefficients of the generalized Fourier series are: 
1/2 1/2 
co— f s(9)wal(0,8)\d9=U f (94+1/2)d9=U/2 
—1/2 —1/2 
t 1/2 
-T72 0 T72 c= f s(S)wal(1, 8)d8 


-1/2 


0 1/2 

=—U f (941/249 - U f ($+ 1/2d9 = U/A 
—1/2 0 

Thus, when a triangular pulse is approximated by the first two 

members of a Walsh function series, the result is a step function. 

Interestingly, even this rough approximation is satisfactory from the 

view-point of the energy norm introduced earlier. To demonstrate, 





1/2 
-T/2 0 T/2 E,— U? j (94+ 1/2)?d$= U?/3 
-1/2 
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whereas the difference energy 


1/4 U2 


| s(9) — cowal (0, 9) — c, wal(1, 9) |? 2 4U? f £?^d£- .—— 


o 3x16 


is only one-sixteenth, or 6.25%, of the energy of the signal being 


approximated. 


This equation genera- 
lizes Pythagoras’ theo- 
rem to an infinite- 
dimensional space 


The energy of a signal represented by a generalized Fourier 
series, Consider a signal s(t) expanded into a series in terms of 


orthonormal basis functions: 


s()= y ckuk(t) 


k=1 


and determine its energy: 


t L aC 


f Y > (cic) ujujdt 


tii=1j=1 


tà 
Es= Js*dt= 
t, 


t2 


= Y Y (cic) f uiujat (1.32) 
imi j=l fs 


Because the basis functions are orthonormal, only those terms in 
the sum of (1.32) are non-zero for which i = j. To sum up, we have 
obtained a remarkable result: 


oo 
Eye ouf (1.33) 


i-1 


The meaning of the above expression is this: The energy of 
a signal is equal to the sum of the energies of all the components 
that make up the generalized Fourier series. 


Optimality of tne signal expansion in terms of orthogonal basis 
functions. Let there be a signal, s(t), for which we introduce 
a finite-dimensional approximation 


N 
$(t)— Y, ckux(t) 


k=1 
with unknown coefficients cx, and require that these coefficients be 
chosen such that the approximation error has a minimum energy: 
ta 
w= |ls—S]]?= f[s— } cku]? dt = min (1.34) 
k 


ti 


The necessary minimum condition consists in that the coefficients 
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cm must satisfy a set of linear equations 
6p/6cm=0, m=1, 2, ..., N (1.35) 


In the expanded form, the approximation error is 
N N N 


u= f [s? —2s J ckuk+ 9, Y, cicjuiuj] dt 
T k=1 ini j=l 


Since the basis functions involved are orthogonal, it follows that 
^ tz 

g : m 
751 (| [cin Um — 28Cm Um | dt)=0 
CCm ty 

In view of the fact that the basis functions have a norm of unity, 
we may conclude that equalities (1.35) will be satisfied when the 
expansion coefficients are chosen such that 

t2 


Cm= J s(t)us(t)dt 


which fully checks with Eq. (1.29) for the coefficients of 
a generalized Fourier series. 

A more thorough analysis (when one considers not only the first, 
but also the second derivative of the error energy) will show that 
the expansion of a signal into a generalized Fourier series assures 
a minimum of the approximation error. 

It is to be noted in conclusion that, by definition, the Hilbert 
signal space possesses the important property of completeness which 
consists in the following. If the limit of the sum 


N 
s(t)= lim Y ciui(t) 
N>% iz1 

exists, then the limit itself is always an element of the Hilbert space. 
Àn important property of this class of spaces is that the norm of 
the approximation error is a monotonically decreasing function of 
N, the number of expansion terms considered. By choosing 
N sufficiently large, it is always possible to minimize the error to 
any acceptably small value. 

Implementation of orthogonal signal expansion. Turn to the 
block diagram of Fig. 1.5 which shows a set-up used to determine 
experimentally the expansion coefficients for an arbitrary signal 
expanded into a generalized Fourier series in terms of a specified 
set of orthonormal basis functions. 

The key elements of the set-up are function generators which 
generate the basis functions in terms of which the expansion is 
carried out. The signal in question is simultaneously fed to an 
assemblage of multipliers each of which multiplies the applied 
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s(t) 





Fig. 1.5 Block diagram of a signal analyzer 


signal by an appropriate basis function. From the multiplier out- 
puts, the resultant signals are applied to integrators. 

With this form of signal processing, a time-invariant signal 
appears across the output of each multiplier at the end of the 
integration time. The magnitude of the output signal is, in accord 
with Eg. (1.29), exactly equal to a particular coefficient of the 
generalized Fourier series. 

Clearly, the performance of the set-up as a whole depends on 
how accurately the basis functions can be reproduced and also on 
how well the multipliers and the integrators operate. 

The set-up shown in Fig. 1.5 is important not only in an applied 
but also in a theoretical sense. From its analysis we can see that all 
of the information embedded in the signal can be represented as 
a set of numbers, although infinite, but yet countable. 


Summary 


<*> For a theoretical study of signals, it is necessary to build their mathematical models. 
<*> Signals are classified on the basis of the significant attributes of the corresponding 
mathematical models. It is customary to class signals into one-dimensional and multi- 
dimensional, deterministic and random, continuous and discrete. There is a special 
variety of discrete signals, called digital signals. 

In dynamic representation, signals can be described, taking into account their behavi- 
our both in the "past" and in the "future". 

Dynamic representation utilizes two elementary signals, one being the switching 
function and the other, the Dirac delta-function. 

By introducing appropriate structures, some sets of signals can be transformed into 
linear functional spaces. 


$88 
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A system of linearly independent vectors forms a basis in terms of which an arbitrary 
element belonging to a linear space can be expanded. 

In a linear signal space, the analogue of the length of a vector is its norm. The square 
of the norm is called the energy of the signal. 

A linear signal space turns into a metric space if one can determine the distance 
(metric) between two vectors. 

In order to determine the angle between two elements of a linear space, resort is made 
to their scalar product proportional to the cross energy of the signals. If the scalar 
product is zero, the signals are called orthogonal. 

The representation of a signal as an expansion in terms of an orthonormal basis set is 
termed a generalized Fourier series. The coefficients of this series are equal to the 
scalar products of the signal being expanded and the corresponding basis vectors. 
The most important examples of orthonormal basis sets are harmonic functions at 
multiple frequencies and Walsh functions. 

The energy of a signal is equal to the sum of all the components that form the 
generalized Fourier series. 

The expansion of a signal in terms of orthonormal basis functions yields a minimal 
r.m.s. error of approximation. 

The extraction of useful information from a signal may be visualized as an 
experimental evaluation of the generalized Fourier series coefficients of that signal. 


Review Questions 


1. Name two or three examples of physical processes describable with stochastic 
mathematical models. 


SAU NM 


. Name the characteristics used to describe pulse signals. 
. Define the difference between a video pulse and a radio pulse. 
. Under what conditions will the replacement of a continuous signal with a discrete signal 


be inadequate? 
. Formulate the principle of dynamic signal representation. 


. State the most important axioms of a linear space. 


5 
6. List the main properties of the delta function. 
7 
8 


. What is the physical meaning of the square of the signal norm? 
9. What is the geometric meaning of the Cauchy-Buniakovski inequality? 
10. Draw several plots illustrating orthogonal signals. 
11. What is the Hilbert space? 
12. What makes the expansion of signals in terms of orthogonal Walsh functions 
convenient? 
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Problems 


1. The figure shows a triangular voltage 
pulse. 


t 
0 Tp 


Write a mathematical model for this signal, 
using a combination of switching functions. 


2. Solve Problem 1 for a symmetrical 
triangular pulse. 


S 


t 
0 Tp/2 Tp 


3. Write a mathematical model for an 


infinite sequence of identical triangular 
pulses. 
s 
U 
t 
=37=27. -T 0 T 27 3T 


4. Using Eq. (1.4) find a dynamic 
representation for the exponential video 
pulse described by the formula: 


u(t) = Uexp( — at)o(t) 


5. Using Eq. (1.4) find a dynamic 
representation for the Gaussian video pulse 


u(t)= Uexp( — Bit) 


defined along the entire infinite time axis. 


Note the way in which Eq. (1.4) must be 
modified. 

6. Show that the delta-function can be 
construed as the derivative of the switching 
function 


8(r) = do/dt 


Hint. Take the derivative of the function 
v(&, t) represented by Eq. (1.1), and pass to 
the limit with $— 0. 

7. Find the energy and norm of the signal 
described by a mathematical model of the 
form 


u(t) Ug exp( — «|t 


8. Find the energy and norm of the 
cosinusoidal pulse 


0, Wot < — n/2 
s(t) - 4 Ucosogt, —1/2<@ot<n/2 
0, Oot > 1/2 
9. The signal u(t) is a symmetrical 
triangular pulse; the signal v(t) is 


a rectangular pulse inscribed in the first. 


U 
u (t) 
v(t) 
Pa t 
—Tp/2 0 Tp/2 


Find the amplitude of the rectangular pulse 
such that the distance between the two 
pulses is a minimum. 

10. Using the principle of orthogonality, 
construct a plot of the function wal (4, 8) on 
the basis of Fig. 1.4. 

11. Show that the distances between any 
two functions out of the set wal (0, 9), wal 
(1, 9) and wal (2, 8) are the same and equal 
to |/2. 

12. Apply a similar analysis to an 
orthonormal set of trigonometric functions 
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(see Eq. (1.30). Compare the results. Is it 
possible to draw an analogy with Py- 
thagoras’ theorem? 


C — 2 nF. Pulse duration is tp — 0.5 us, and 
pulse amplitude is Vj, — 12 V. 


R 


V, 
Advanced Problems Ow L : 
: 2 C 
13. An experiment has yielded the ! 
following oscillogram of a signal: : " kG 
yV Prove that the real pulse can in this case 
- be replaced with a mathematical model of 
60 the form 4ô(t) What should the coefficient 
A be in this case? 
40 List several simple physical situations out 
of everyday practice, when the actual effect 
20 on a system may be approximated with 
a delta-impulse. 
5 i0 15 20 25 30 rys 16. Prove that the delta-function may be 


It is hypothesized that the signal can be 
described by an exponential time function. 
Propose the simplest possible graphical 
method to test this hypothesis. 

14. Propose a mathematical model for the 
following signal: 





15. A series resonant circuit is driven by 
a source of pulsed emf. The system’s 
parameters are: R=5Q, L=10 pH, and 


treated as the limit 
: | sinqt 

6 (t) = lim (5 a) 
q*9 \ T t 

17. Generalize the concepts of energy and 
norm to vector signals of an arbitrary 
dimensionality N. 

18. Prove that if H is a real Hilbert space 
containing the signals u and v, the 
parallelogram equality is valid: 
lu+ol? +u- vl = 2u? +2] vN? 

19. Prove that the identity 
4(u, v?) - ux v]? — u-v]? +jllu 

+jo|?—j|u—jo|? 
holds in a complex Hilbert space. 

20. Let. {ug(t), k=1, 2, ..] be an 
orthonormal basis in a Hilbert space H. 
Prove that Parseval's theorem 


(s s)- Y (s. ugs», ug 
k=1 


holds for any sı, s;€H. 


AL 


"n 


~ 


E 


Examples of periodic 
signals 


Chapter 2 


Spectral Representations 
of Signals 


Of the many sets of orthogonal functions that can be used as 
basic ones in the representation of communication signals, a special 
place is occupied by harmonic (sine and cosine) functions. 
Harmonic signals are important for communication applications 
due to several reasons. Among other things, harmonic signals are 
invariant under the transformations effected by linear stationary 
electric circuits. If the input to a linear circuit is a harmonic 
oscillation, the output from that circuit will likewise be a harmonic 
oscillation differing from the original one solely in amplitude and 
initial phase. Also, harmonic signals are relatively simple to 
generate. 

If a signal is represented as the sum of harmonic oscillations 
differing in frequency, the signal is said to have been resolved into 
its spectrum in terms of harmonic functions. The sum of the 
individual harmonic components of the signal forms its spectrum. 


2.1 Periodic Signals and Fourier Series 

The mathematical model of a process cyclically repeating itself in 
time is a periodic signal, s(t), such that 
s(t) — s(t 4- nT) hs cl og 2. (2.1) 
where T is the period of the signal. 

The spectral representation of a signal can be obtained by using 
the expansion into a Fourier series. 

The Fourier series. Let us define over the time interval [ — T/2, 
T/2] the orthonormal basis (already discussed in the previous 


chapter) which is formed by harmonic functions with multiple 
frequencies: 


Uy = Uy T 

“= V2/Tsin 2nt/T 

u, = |/2/Tcos 2nt/T (2.2) 
u, = |/2/Tsin 4nt/T 

u, = V2/Tcos nt/T 
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Any function u, out of this basis satisfies the condition of 
periodicity, Eq. (2.1). On expanding the signal s(t) in terms of this 
basis, that is, on finding the coefficients 


Cm = (s, Um) (2.3) 
we get its spectral representation 
© 
s(t)= ». CmUm(t) (2.4) 
m=0 


The expansion is valid along the entire infinite time axis. The series 
of the form in (2.4) is called the Fourier series. 

Let œ; = 2x/T be the fundamental frequency of the sequence that 
forms the periodic signal. When finding the expansion coefficients 
by Eq. (2.3), the Fourier series for a periodic signal may be written 
in the form 


oC 


s(t) 2 ao/2 - Y, (ancos no, t + basin not) (2.5) 
n=1 


where the coefficients are 
T/2 


2 
do = s(t) dt 
o ri, 
2 o 
an=— | s(t)cosno,tdt (2.6) 
T_T% 
'5 Th 
b,—— f s(t)sinna,tdt 
-Th 


Thus, in the genetal case a periodic signal contains 
a time-independent constant component and an infinite set of 
harmonics at frequencies ®,=n@,, n=1,2,3,.., which are 
multiples of the fundamental frequency of the sequence. 

Any harmonic in a Fourier series is characterized by its 
amplitude A, and its initial phase @,. To show this, the expansion 
coefficients should be written as follows: 


An = AnCOS (Qn 

bn = Ansin Opn 

so that 

An= Vai + bà 
and 

9, = arc tan (b,/a,) 


Substituting the above expressions into Eq. (25) yields an 
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equivalent form of the Fourier series 


S(t) — ag/2 4- Y, Ancos (not — qx) (2.7) 
n=1 
which is sometimes more convenient to use. 
The spectral diagram of a periodic signal. This term applies to 
a plot of the Fourier coefficients for a specific signal. It is usual to 
distinguish an amplitude diagram and a phase diagram (Fig. 2.1). 
The numbers laid off as abscissae are the discrete harmonic 
frequencies. 
An 





(a) 
Fig. 2.1 Spectral diagrams of a periodic signal: (a) amplitude; (b) phase 


Of the two, the amplitude diagram is more frequently used as it 
contains information from which we can determine the percentage 
of a particular harmonic in the spectrum of the entire periodic 


signal. 








Example 2.1. The Fourier series of a periodic train of rectangular 
video pulses of known parameters (x, T, A), which is even about the 


point t — 0. 


In communication engineering, use is made of the ratio 


q=T/t 


which may be called the reciprocal pulse duty factor*. Using Eqs. 


(2.6), we get 
49/2 = A/q 
24 "2 


9 
The pulse duty factor 


2A. 
áp | cos no, tdt = sin (neo, 1/2) 


T -ij 


This leads us to a Fourier series of the form 


«o7 dao] 453 
homed 


n-1 


E UO oi no, | (2.8) 
nn/q 





* In the UK and US literature on the subject, use is made of 1/T, called 
the pulse duty factor.— Translator's note. 





@ 
The cut-off angle 


Ch. 2 Spectral Representations of Signals 45 





Fig. 2.2 Amplitude spectrum of a periodic sequence of rectangular video 
pulses: (a) for a large pulse period to pulse duration ratio; (b) for a small 
pulse period to pulse duration ratio 


The typical amplitude diagrams of the sequence in question for 
two limiting cases are shown in Fig. 2.2. 

It is important to note that a sequence of short pulses recurring 
at widely spaced intervals (q> 1) has a spectrum rich in harmonics. 

The spectral diagram of the above form is said to have a lobed 
structure. 

Example 2.2. The Fourier series of a periodic pulse sequence 
formed by a harmonic signal of the form U mcos @,t limited at Uo (it 
is assumed that |Uo|<Um). 

A special parameter, the cut-off angle, 9, is used to describe such 
a signal. It can be deduced from the relation 


U mcos $= U, 


Hence, 9 = arccos(U$/U ,). Then the quantity 29 will be the 
duration of one pulse in electrical degrees.* 
„Analytically, the pulse repeated in the sequence can be written as 


s(t)=U,,cos@,t-—U,), —9«o,t«8 


The constant term of the sequence is 
S/o; 


a,/2=— J (Umcosw,t — Uj)dt 
—9/n1 
i U 
=ar f (Us cos ot — Uo)d (o1) = ^. (sins — $cos 9) 


The amplitude coefficient of the fundamental harmonic is 
1 9 


dite J (U mcos œt — Uo) cos œt d (ot) 
-9 


= (U m/n) (9 — sin $ cos 9) 


* [n the UK literature on the subject this quantity is called the angle of 
current flow. In the US literature, it is known as the operating angle. 
— Translator's note. 
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The amplitude coefficients a, of the 2nd, 3rd and higher 
harmonics (n = 2, 3, ..) are found in a similar way: 


sinnScos 9 — ncos n8 sin 8 





=(2U 
an= (2U p/n) n(n? =f 
The result thus obtained is usually written as 
ao/2 = U mYo (9) A. I. Berg (1893- 
. 1979), a leading So- 
an = UmYn(9) viet scientist in the 
. field of telecommuni- 
where Yo, Yı, Y2, =- are Berg functions: cations 


Yo (9) = (1/n)(sin 8 — cos 9) 





yı (9) = (1/1) (8 — sin 8cos 9) (2.9) 
. Ssinn9cos 9 — ncos n8 sin 8 
¥n(9) —-— (2/n) 2 
n(n* — 1) 
for n22,3, ... 





0 45 90 135 180 
Fig. 2.3 Plots of the first few Berg functions 


Plots of the functions Yọ, Yı, and y, are shown in Fig. 2.3. 
Since these functions are frequently used in engineering 
calculations, they are tabulated in an appendix to this book along 
with a computer subroutine in FORTRAN. 





The complex form of the Fourier series. The principal formula 
(2.5) of Fourier analysis as applied to periodic signals can be given 
an elegant form, if we represent harmonic functions as a sum of 
exponentials with imaginary exponents. By applying Eulers for- 
mulas, we can re-write the series (2.5) as 

jno,t , 4-jnot jno,t jno,t 
e +e e e ) (2.10) 


S(t) = ag/2 + (« +b - 
o p L^ 5 n 5 
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Instead of a, and by, we introduce new coefficients 
Cn 7 (an — jbn)/2 


for n = 1, 2, 3, ... We may as well determine the coefficients C, for 
negative indices n, such that 


C -n= (an+ jbn)/2 = Ch 


because the coefficients a, are even, and the coefficients by are odd 
with respect to the indices. Thus, the summation in (2.10) may be 
extended to include all values of n, both positive and negative: 


s(— Y, Cuexp(no,t) (2.11) 


n= 


Equation (2.11) is the Fourier series in complex form. As can be 
readily seen, the complex coefficients are given by 


T/2 
=o f s(t) exp(—jna,t) dt (2.12) 
-Tí 


C, 
The concept of negative frequencies. Since it is symmetrical about 
the origin of frequencies, the spectral diagram of a periodic signal 
in the form given by (2.11) contains components on the negative 
half-axis. 
A few remarks are in order with regard to the concept of 
negative frequency. Consider the identity 


e Jt +e - jo,t 


cos œt = 
2 

In the method of complex amplitudes, the term (1/2)exp(j@;t) is 
represented on a complex plane as a phasor of length 1/2, which 
rotates at angular velocity o, in the direction of increasing polar 
angle wt. The phasor corresponding to the term (1/2)exp( — jo, t) 
differs in that it rotates in the opposite direction. On combining, 
these two complex numbers yield a real number. 

In the series of Eq. (2.11), the terms with positive and negative 
frequencies form pairs. For example, 


Cu exp(jno, t) + C -nexp( — jno,t) = |Cn| exp [j (no, t + On)] 
+ [Cul exp[ — (no, t + 94)] = 2|Cu] cos (no, t + Pn) 


To sum up, a negative frequency is not a physical but 
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a mathematical concept associated with the manner in which 
complex numbers are represented. 


Representation_of a periodic a on a complex plane. The 
structure of the Fourier series in Eq. (2.11) is such that a periodic 


signal can be represented by an infinite sum of phasors rotating in 
a complex plane (Fig. 2.4). 

The construction involved is carried out as follows. From the 
origin (point 0), we draw a real phasor C, on the complex plane. 
This phasor represents the term whose number is n=0 Then. 
in Eq. (2.11) we set t equal to zero and construct a sum of pta- 
sors 


C,=C,+C,+C;+.. 
C- =C_,+C_,4+C_3+... 


answering the contributions made by the positive-frequency and 
negative-frequency terms. For a converging Fourier series, each of 
the sums is represented by a phasor of finite length. 






w e 2 w 
C, /C2 
"EE E Cres S(t) 
0 C4 
wy 
3w N 


Fig. 2.4 Graphic representation of a Fourier series in complex form 


As already noted, the coefficients of a Fourier series for positive 
and negative frequencies are complex conjugate. Therefore the 
C,+C_ phasor is always real. When it is combined with the 
constant term Co, it forms a phasor whose length, s(0), is equal to 
the instantaneous value of the signal at the initial instant of time, 
to. 

Then the picture is transformed: the phasors C,, C,;,.. for 
positive frequencies rotate at angular velocities @,, 20,, .. up in 
phase angle, whereas the phasors C_,, C ,, .. rotate in the 
opposite direction. The tip of the resultant phasor gives the current 
value of the signal. 

The pictorial representation we have just examined is very helpful 
sometimes. We shall use it in the next section. 
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2.2 Spectral Analysis of Nonperiodic Signals. 
The Fourier Transform 


Fourier analysis permits an in-depth and fruitful generalization 
with which we can readily obtain spectral characteristics for 
nonperiodic signals. Those of special interest to communication 
engineering are signals in the form of single pulses. 

Periodic continuation of a pulse. Let s(t) be a pulse signal of 
finite duration. If we mentally add to it similar signals recurring 
with period T, we shall obtain the already familiar periodic 
sequence, Sper(#), which can be represented as a complex Fourier 


series 


Sper(t)= Y, Cyexp(jnw,t) (2.13) 
n=-« 
with the complex coefficients given by the integrals 
j 55 
C= T J Sper (t) exp { — jno, t) dt (2.14) 
—Tia2 


In order to go back to a single pulse signal, we should let the 
period T tend to infinity. Then, 

(1) The frequencies of adjacent harmonics, no, and (n+ 1)o,, 
will be as close as we may wish, so that in Eqs. (2.13) and (2.14) we 
may replace the discrete variable no, with a continuous variable œ, 
which is the current frequency. 

(2) The amplitude coefficients C, decrease without bound because 
the period T appears in the denominator of Eq. (2.14). 

Our objective is to find the limiting form for Eq. (2.13) with T 
tending to infinity. 

The concept of the spectrum of a signal. Let us take advantage of 
the fact that the coefficients of a Fourier series form complex 
conjugate pairs 


Cn = Anexp (Gn) 

C_n= Anexp(— j@n) 

Each pair represents a harmonic oscillation 

Anexp[j(n@,t + @n)] + Anexp[ —j(no,t + «)] 
= 2An cos (n@,t + On) 

with a complex amplitude 


2Anexp (jn) = 2Cn 


Consider a small interval of physical frequencies, Aw, in the 
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neighbourhood of some frequency @). The number of spectral 
components contained within that interval is given by 


N = Ao/o, = AoT/2n 


Since their frequencies differ by an amount which may be made as 
small as we like, we may combine them as if they were of the same 
frequency and had the same complex amplitude 

^ x 


2Cr = E: f s(Qexp( —joon dt 


As a result, we obtain the complex amplitude of an equivalent 
harmonic signal representing the contributions of all the spectral 
components contained within the interval Aa: 

oo 


2N 
AAo, =—— | s(t)exp(— jaot)dt = 


T a * 
Ao * : 
pem f s(Dexp( — jaot) dt (2.15) 


Here we have defined a new function 


S(o)— f s(t)exp( — jot)d: (2.16) 


which is variously called the amplitude spectral density [20], the 
complex spectral density*, the amplitude spectrum [20], or simply 
the spectrum** of the signal s(t). It is the Fourier transform of the 
signal. 

The physical significance of the spectrum. The result can be best 
interpreted if we change from the angular frequency o to the cyclic 
frequency 


f^ o/2n 
Then Eq. (2.15) will take the form 
AAs = 28 Qnfo) Af (2.17) 


It should be interpreted as follows: The spectrum S (2nf,) = S (c) is 
a scale factor connecting the length of the frequency interval Af and 
the corresponding complex amplitude AAy, of the harmonic signal 
at the central frequency fo. 

A fact of fundamental importance is that the spectrum is 





* S. Stein and J. Jones. Modern Communication Principles. 

** C. W. Helstrom. Statistical Theory of Signal Detection Oxford: 
Pergamon Press, 1968. A. Peled and B. Liu. Digital Signal Processing. John 
Wiley and Sons, New York, 1976.— Translator's note. 
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w=- oo 


Fig. 2.5 Vector diagram of a nonperiodic signal (the plot on the right of 
the figure relates the magnitude of the spectral density to frequency) 


a complex function of frequency and, as such, it carries information 
about both the amplitude and the phase of the elementary sine 
waves. On the phasor diagram of a nonperiodic signal (Fig. 2.5), 
the lengths of the elementary phasors are infinitesimal, so instead of 
the broken lines (T is finite) we obtain smooth curves (T tends to 
infinity). If we choose a set of equidistant points 0<@, < ©; <... 
on the frequency axis, the magnitude of the spectrum, |S(c)|, will 
establish a linear scale along the curves: an increase in the magni- 
tude of the spectrum within the specified frequency range will lead 
to an increase in the spacing between the frequency points on the 
phasor diagram as well. 

This diagram has been plotted for some fixed instant of time. 
With time the shape of the curves changes in a very complex 
manner because the angular velocity at which the corresponding 
portions of the curves rotate increases with increasing frequency. 
Actually, however, what is important is not the shape of the curve, 
but the projection of its terminal point on the horizontal axis. 

The inverse Fourier transform. Now we shall solve the inverse 
problem of the spectral theory of signals: We shall recover a signal 
from its spectrum which is deemed to be known. 

Let us assume again that the nonperiodic signal is derived from 
a periodic sequence when its period tends to infinity. Using Eqs. 
(2.13) and (2.14), we may write 

oC 


s(t)— lim Y 5 ne)exp inet) 


T—n-2-—oo 


The coefficient 1/T is proportional to the difference in frequency 


The signal waveform 
depends on both the 
magnitude and phase 
of the spectrum 


52 


The inverse Fourier 
transform 


A 
Solve Problem 3 


Part One. Signals 


between adjacent harmonics: 
, l 
1/T = @,/2n = —— [no —(n—1)a,] 
2n 
for any integer n. Thus, 


1 aC 
s(t)— lim —— Y  S(no,)exp(no, t) [no — (n — 1)a,] 
To £T n=- 
Since in the limit of large T' the frequency spacing between 
adjacent harmonics decreases without bound, the last sum may be 
replaced with an integral 


st) f S(w)exp (jat) do (2.18) 


Equation (2.18) is known as the inverse Fourier transform for the 
signal s(t). 

This brings us to a fundamental conclusion: The signal s(t) 
and its spectrum S(@) are uniquely related by a Fourier transform 
pair: 





S(@)= í s(t)exp( — jon dt 
B (2.19) 


1 x 
s(t)= p f S(@)exp(jat) do 


The technique of spectral expansion has substantially enriched 
signal theory. It often happens, for example, that the mathematical 
model of a signal in the form of the function s(t), that is, in the 
time domain, is complicated and not easy to visualize. In contrast, 
the treatment of the same signal in the frequency domain, that is, 
with the aid of the function S(o), proves very simple. What is more 
important, however, is that the spectral representation of signals 
offers a direct approach to the response analysis of a wide class of 
communication circuits and systems. These matters will be taken up 
in detail in Chapters 8 and 9. 

The condition for the existence of the spectrum of a signal. In 
mathematics, it has been explored in detail what properties the 
function s(f) must possess in order that its Fourier transform can 
exist. 

Omitting proof and the rather subtle points that are involved in 
the very concept of the existence of a mathematical entity, we shall 
formulate the final result: For a signal s(t) to have its spectrum 
S(@), it is essential that the signal should be absolutely integrable, 
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and this means that the integral 
f |s(t)|dt< + 


should exist. 

The above condition substantially limits the class of eligible 
signals. Thus, we cannot speak, in the classical sense, about the 
spectrum of a harmonic signal, s(t)= Acos ot, defined along the 
entire infinite time axis. 

Fortunately, present-day mathematics has techniques with which 
the spectra of nonintegrable signals can be evaluated in 
a reasonable way. In this case, however, the spectra will be 
generalized functions, and not the conventional or classical ones. 
The spectral representation of nonintegrable signals will be 
discussed later. 

Now we shall consider several specific examples of how spectra 
are found. 

The spectrum of a rectangular video pulse. Let there be a signal, 
s(t), of amplitude U and duration tp, which is symmetrical about 
the origin of time. On the basis of Eq. (2.16), 


tp/2 1p/2 


S@)=U [| exp(—jo)dt—- U f (cosot —jsin ot) dt 
—tp/2 —tp/2 
tp/2 


=2U | cos @tdt=(2U/o)sin (@tp/2) 
0 


Thus, the spectrum of the signal in question is a real function of 
frequency. It is convenient to introduce a dimensionless variable, 
E = @Tp/2. Then the result can finally be written as follows: 


S(o) = Utp(sin &/) (2.20) 


It is interesting and important to note that at the zeroth fre- 
quency the spectrum is equal to the area of the pulse 


S (0) = Utp 
A plot of the function in (2.20) is shown in Fig. 2.6. 
The spectrum of an exponential video pulse Consider the signal 
described by the function 
s(t)= Uexp( — at) o (t) 
for the positive real value of the parameter o. 


Strictly speaking, such a signal may only arbitrarily be called 
a pulse because of its behaviour at t— oc. However, the condition 
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between adjacent harmonics: 
l 

1/T = œ,/27 = = [no — (n — 1)o,] 
2n 

for any integer n. Thus, 


— - x 
s(t) — lim x Y S(no,exp(no, t) [no — (n — 1)0,] 
To 2M n=- 


Since in the limit of large T the frequency spacing between 
adjacent harmonics decreases without bound, the last sum may be 
replaced with an integral 


2n 


= f S(@)exp (jat) do (2.18) 


Equation (2.18) is known as the inverse Fourier transform for the 
signal s(t). 

This brings us to a fundamental conclusion: The signal s(t) 
and its spectrum S(œ) are uniquely related by a Fourier transform 
pair: 


S(@)= f s(t)exp( —jot)dt 
i (2.19) 


s()= 5 f S (@)exp (ot) do 


The technique of spectral expansion has substantially enriched 
signal theory. It often happens, for example, that the mathematical 
model of a signal in the form of the function s(t), that is, in the 
time domain, is complicated and not easy to visualize. In contrast, 
the treatment of the same signal in the frequency domain, that is, 
with the aid of the function S (œ), proves very simple. What is more 
important, however, is that the spectral representation of signals 
offers a direct approach to the response analysis of a wide class of 
communication circuits and systems. These matters will be taken up 
in detail in Chapters 8 and 9. 

The condition for the existence of the spectrum of a signal. In 
mathematics, it has been explored in detail what properties the 
function s(t) must possess in order that its Fourier transform can 
exist. 

Omitting proof and the rather subtle points that are involved in 
the very concept of the existence of a mathematical entity, we shall 
formulate the final result: For a signal s(t) to have its spectrum 
S (c), it is essential that the signal should be absolutely integrable, 
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and this means that the integral 
f |s@[dt< + oc 


should exist. 

The above condition substantially limits the class of eligible 
signals. Thus, we cannot speak, in the classical sense, about the 
spectrum of a harmonic signal, s(t)= Acos ot, defined along the 
entire infinite time axis. 

Fortunately, present-day mathematics has techniques with which 
the spectra of nonintegrable signals can be evaluated in 
a reasonable way. In this case, however, the spectra will be 
generalized functions, and not the conventional or classical ones. 
The spectral representation of nonintegrable signals will be 
discussed later. 

Now we shall consider several specific examples of how spectra 
are found. 

The spectrum of a rectangular video pulse. Let there be a signal, 
s(t), of amplitude U and duration tp, which is symmetrical about 
the origin of time. On the basis of Eq. (2.16), 


tp/2 15/2 

$(0)-U f exp(—jot)dt=U f (cosot —jsin en dt 
—15/2 —1p/2 
1p/2 


—2U [| cos wt dt = (QU/o)sin (15/2) 
j 0 


Thus, the spectrum of the signal in question is a real function of 
frequency. It is convenient-to introduce a dimensionless variable, 
Č = @Tp/2. Then the result can finally be written as follows: 


S(@) = Utp(sin £/£) (2.20) 


It is interesting and important to note that at the zeroth fre- 
quency the spectrum is equal to the area of the pulse 


S(0)= Utp 


A plot of the function in (2.20) is shown in Fig. 2.6. 
The spectrum of an exponential video pulse Consider the signal 
described by the function 


s(t)= Uexp( — at) o (t) 


for the positive real value of the parameter «. 
Strictly speaking, such a signal may only arbitrarily be called 
a pulse because of its behaviour at t oo. However, the condition 
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Fig. 2.6 Plot of the relative spectrum of a rectangular video pulse as 
a function of the parameter € = wt,/2 


X20 assures a sufficiently rapid (exponential) decrease of the 
instantaneous values of the signal with increasing time. In 
communication engineering, the practical duration of such pulses is 
taken to be that over which the signal decreases to one-tenth of its 
original level: 


exp( — x15) = 0.1 
Hence, 
Tp = 2.3026/a 


The spectrum of an exponential video pulse is given by 


S(a) = UTapt (ddr 
0 


=[— Ufa + jo)] exp [— (« + jo) t]iz 6 
= UJ (a + jo) (2.21) 


The spectrum of an exponential waveform differs from that of 
a rectangular pulse in two fundamental aspects: 

1. In accordance with Eq. (2.21), the spectrum S (o) does not go 
to zero at any finite value of frequency. 

2. The spectrum of an exponential pulse is a complex-valued 
function 
S(o) =| S(@) |exp [ju (o)] 
with modulus |$(o)|- U/|/a? -- o?, and argument (o)= 
= — arc tan (w/a). 

The respective plots appear in Figs. 2.7 and 2.8. 

The spectrum of a Gaussian video pulse. This type of signal is 
described by a function of the form 


s(t) - Uexp( — Bt?) 
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Fig. 2.7 The magnitude of the Fig. 2.8 The argument of 
spectrum of an exponential the spectrum of an 
pulse exponential pulse 


This mathematical model is often used in cases where the pulse 
has a high degree of “smoothness”. The effective duration of 
a Gaussian pulse is taken to be that over which the signal decreases 
to one-tenth of its maximum level. Referring to the plot, it can be 
seen that the duration tp must satisfy the relation 


exp[ — B(tp/2)’] = 0.1 
On re-arranging, we get i 
tp = 2|/ — In 0.1//B = 3.035/)/B (2.22) 


To determine the spectrum, we need to evaluate the integral 
S(@)=U f exp(—Bt?)exp(—jot)dt (2.23) 


Now the integrand should be re-arranged in such a way that we 
may use the tabulated integral 


f exp( — x?)dx =|/x 
For this purpose, from the exponent in (2.23) we isolate the 
complete square: 
Bt? + jot = Bt? + jot — 9?/4p + o?/4p 
= (V Bt + jo/2 V BY. + o?/4B 
Therefore, 


S (o) = U exp( — o?/4p) f ex] - (Vies m ) Ja 





Let us introduce a new variable 
6=//Br+jo/2/B 
such that 


dt= dé//B 
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As a result, the sought spectrum takes the form 
_ Uexp( — 07/4) 7 





5 (c) V5 J exp( — £?)d& 
Hence, finally, 
S(@) = U |/x/Bexp( — w?/48) (2.24) 


To sum up, the spectrum of a Gaussian pulse is real and is 
described likewise by a Gaussian function of frequency. 

The spectrum of the delta function. Let the signal s(t) be a short 
pulse concentrated at point t — 0 and having an area A. The 
mathematical model of this pulse is 


s(t) = A8(t) 


To find the spectrum of this signal, we need to evaluate the 
integral 


S(0)— A f exp(—jot)d(t)dt 


In Chapter 1 we have learned about the filtering properties of the 
delta function. This integral is equal to the value of the classical 
function at the point where the generalized function is concentrated. 
Therefore, 





S(@) = A = const (2.25) 





Thus, the 6-impulse has a flat spectrum at all frequencies. It is 
interesting to interpret the result on a phasor diagram (see Fig. 2.5). 
Just as the impulse occurs (£— 0) all elementary harmonic 
components which differ in frequency combine coherently, because 
in accord with Eq. (2.25) the spectrum is real. As the frequency is 
increased, their amplitudes do not decrease (compare with the 
previous examples) In consequence, the signal has an infinitely 
large magnitude at t — 0. At all other times the phasor sum of the 
components is zero. 

Relation between the duration and bandwidth of a pulse. From 
an analysis of the special cases examined so far, an important 
conclusion may be drawn: As the duration of a pulse decreases, its 
bandwidth broadens. 

Here and elsewhere, the bandwidth refers to the frequency 
interval within which the modulus of the spectrum is not smaller 
than some specified level. For example, it may range between |S|max 
and 0.1 |S|max. 

Consider a rectangular video pulse and assume that the upper 
frequency limit is the frequency at which the first zero occurs in the 
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spectrum. This frequency can readily be found from the condition 
Oup tp/2 =T 
or 
foptp=1 

In the case of an exponential video pulse, we arbitrarily assume 
that at the upper frequency limit the modulus of the spectrum 


reduces to one-tenth of its maximum value. Hence, it follows (see 
Eq. (2.20) and further) that 


1/V/1 + (oup/o)? = 0.1 
ol 
Oup = |/ 99a 
and 
fap = Qup/2n = 1.5840 
Since the effective duration of an exponential pulse is 
Tp = 2.303/a 
the product 
fap Tp = 3.647 


Finally, the spectrum of the -impulse which has an infinitesimal 
duration extends along the frequency axis without bound. 

To sum up, the product of the bandwidth by pulse duration is 
a constant number which depends solely on the pulse form and has, 
as a rule, a value of the order of unity: 


fup tp = O(1) 


The above relation is of primary importance for communication 
engineering. It sets the requirement for the bandwidth of 
a particular circuit or device when the signal duration is specified in 
advance. For example, as the pulse duration is reduced, the 
bandwidth of the amplifier that is to handle the signal must be 
increased in proportion. By the same token, short noise pulses 
which possess a broad bandwidth may impair the quality of 
reception over a significant frequency band. 


2.3 Basic Properties of the Fourier Transform 


In the preceding section we have learned how the Fourier 
transformation is applied and have found the spectra of simple, but 
frequently occurring pulse signals. Now we shall consider the 
properties of the Fourier transform. 
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Linearity of the Fourier transform. Given a set of signals s,(t). 
s2 (t), .., we can define the Fourier transform of their weighted sum 
by the formula 





X risi(t) & > riSi(o) (2.26) 





Here r; are arbitrary numerical coefficients. The validity of Eq. 
(2.26) can be proved by directly substituting the sums of signals in 
the Fourier transform (2.16). 

Properties of the real and imaginary parts of the spectrum. Let 
s(t) be a signal which takes on real values. In the general case, it 
has a complex spectrum 
S(@)= f s()coserdr—j f s(t)sin œtdt = A (o) — jB(o) 


On substituting the above expression in the Fourier inversion 
formula, Eq. (2.18), we get 


1 x 
s(j= ee f [A(@) —jB(@)] (cos œt + jsin o) do 


For the signal subjected to a direct and an inverse Fourier 
transformation to remain real, we must require that 


f A(@)sin etdo =0 
and 
Í B(o)cos otda — 0 


This will occur only if the following condition is satisfied: The real 
part A(«) of the spectrum of the signal is an even function of fre- 
quency and the imaginary part B(c) is an odd function of frequency: 


A(a) = A(—0)B(o) = —B(—0) (2.27) 
The spectrum of a time-shifted signal. Suppose that for a signal 

s(t) we know that 

s(t) e S(o) 

Consider a similar signal, but occurring tọ seconds later. Taking the 


point ty as the new origin of time, we can designate the translated 
signal as s(t — tọ) Let us show that 





S(t — t) e S (o)exp( — jato) (2.28) 
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This is so because 
s(t— to) f s(t — to) exp (—jat) dt 
= | s(x)exp(-— joto) exp ( — jax) dx 


= S(o) exp ( — jato) 


At any value of tọ the complex number exp ( — jmt,) has a modu- 
lus of unity. Therefore, the amplitudes of the elementary harmonics 
that constitute the signal are independent of its position on the time 
axis. Information about the signal is embedded in the phase angle 
of its spectrum. 

The dependence of the spectrum on the time scale adopted. 
Suppose that the original signal s(t) is subjected to 
a transformation involving a change in the time scale. This implies 
that the role of time t is now played by the new independent 
variable kt (here k is some real number). If k 1, the original signal 
is compressed in time. If 0<k<1, the signal is expanded. 
It has been found that if s(t)<>S(@), then 


1 
s(kt)o "E (c/k) (2.29) 


To demonstrate, 


s(kt) f s(k) exp (— jot) dt = — f s(x) exp ( — jax/k)dx 


x 


from which Eq. (2.29) follows directly. 

Thus, if we wish to compress a signal in time while retaining its 
form, we should distribute the same spectral components over 
a broader frequency interval and reduce their amplitudes in 
proportion. 

An interesting special case of time scale transformation is the 
reversal in time, k= — 1. Using Eq. (2.29), we find the spectrum of 
the time-inverted signal: 





s(tinv) — S(—@) (2.30) 





In the case of time reversal, the modulus of the spectrum remains 
unchanged, but the positive and negative frequency regions of the 
spectrum are interchanged, and the initial phases of all harmonics 
are shifted through 180°. 
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The integral on the right-hand side of Eq. (2.35) is called the 
convolution of the functions V and U. Symbolically, it will be de- 
signated as 


J V(QU(o — §) dé = V(@)* U(o) 


Thus the spectrum of the product of two signals is equal, to 
within a constant, to the convolution of the spectra of the 
cofactors: 





u(t)v(t)—> x V (5) « U (c) (2.36) 





The reader can readily prove that the operation of convolution is 
commutative. This means that the order of the functions involved 
may be reversed: 


V (o) U (o) = U (o)s V (o) 


The convolution theorem we have just proved may be reversed. If 
the spectrum of a signal can be represented as the product 


S (o) = S, (0) $; (o) 


such that S (œ) s(t) and $5(o)«» s; (t), then the signal s(t)<> S(@) 
is the convolution of the signals s,(t) and s,(t), but in the time 
rather than in the frequency domain: 


$,6)5,()e f sit- 5), (dE (2.37) 


We leave it for the reader to prove this formula. 


2.4 Spectra of Nonintegrable Signals 


Many of the mathematical models widely used in communication 
theory do not satisfy the requirement of absolute integrability. This 
implies that the Fourier transformation in its usual form is not 
applicable. Yet, as already noted, we may speak of the spectra of 
such signals, if we assume that these spectra may be described by 
generalized functions. 

The spectrum of a time-invariant signal. The simplest 
nonintegrable signal is a constant quantity, U, — const. Suppose 
that this signal can be represented by an inverse Fourier transform 


1 x 
Up = on f S(@) exp (jot) do 
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in which the spectrum S(@) is yet unknown. If we recall the filtering 
properties of the delta function, it is an easy matter to conclude 
that for this equality to be satisfied identically, we must set 


S(@) = 21U $9 (o) 
Then, 


U, e 2nU3(a) (2.38) 


The physical meaning of the above result is easy to grasp: 
A time-invariant signal has a spectral component solely at the 
zeroth frequency. 

The spectrum of a complex exponential signal. Let 


s(t) = exp (G1) 


be a complex exponential signal of a known frequency o. It is easy 
to see that this signal does not possess the property of absolute 
integrability, because the function s(t) does not tend to any limit as 
t goes to t oc. 

Let us take the Fourier transform of the signal: 


1 x 
exp (=. f S(o)exp (jot) do 


and match the spectrum so that the equality turns to an identity. 
Using the filtering properties of the delta function, we immediately 
obtain ‘an important result: 


exp (jot) 2r (0 — oo) . (2.39) 


The following points deserve to be noted. 

(I) The spectrum of a complex exponential signal is zero 
everywhere except the point @=@p), where it has 
a delta-singularity. 

(2) The spectrum of a given signal is not symmetrical about the 
point œ — 0, but is concentrated in the region of either positive or 
negative frequencies. 

The spectrum of harmonic oscillations. Let 


S(t) = cos ost 
By Euler's formula, 
s(t) = [exp (oot) + exp( — j@ot) ]/2 


From the spectrum of the complex exponential signal derived 
earlier and from the linearity of the Fourier transform, we may 
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immediately write the spectrum of a cosine signal as 


cos ote x [6(o — Wo) + lo + @Q) | (2.40) 


The reader himself can readily prove that for a sine signal the 
following relation is valid 





sin œt — jr [8(o — Wo) — 5(@ + @) | (2.41) 





The two signals are real functions of time, therefore their spectra 
are even or odd functions of frequency. 

The spectrum of an arbitrary periodic signa]. Earlier, we analysed 
periodic signals with the aid of Fourier series. Now we can expand 
our idea about their spectral properties and describe periodic 
signals by use of Fourier transforms. 

Let 


s()— Y Caexp(no,t) 
n= -%0 


be a periodic signa! defined by a complex Fourier series of its own. 
On the basis of Eq. (2.39) and recalling the linearity of Fourier 
transformation, we can immediately write the spectrum of this 
signal as 





S(@)=2n Y Clo- no) (2.42) 





In configuration, the corresponding plot of the spectrum is identical 
to the usual spectral diagram of a periodic signal. The plot is for- 
med by -impulses in the frequency interval +no,. 

The spectrum of the switching function. As the last example of 
how to calculate the spectrum of a nonintegrable signal, we shall 
consider the spectrum of the switching function o(t) which, for 
simplicity, we shall define at all points except the point t=0 (cf. 
(1.2): 


To begin with, it should be noted that the switching function can 
be derived from an exponential video pulse by passing to the limit: 
( lim exp(— at),t>0 


c(t) 24 27° 
(e 0, t«0 
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Therefore, in order to find the spectrum of the switching function, 
we should pass to the limit as à 0: 


o(t) lim — 
a0 ie 4 + jo 


The direct passage to the limit, under which 


c(t) &1/jo 


holds at all frequencies except at œ = 0. This case must be examined 
separately. 
To begin with, we split the spectrum of an exponential signal into 
its real and imaginary parts: 
1 u a jo 
(rojo) «+a? atoa? 


The limiting value of the first term vanishes for any o #0. On 
the other hand, 

f a do f d (w/a) -— 
x^ -o0? +, 14 (a/a)? 





irrespective of the magnitude of « Hence 


- = mó(c) 


lim ES 





To sum up, the switching function and its spectrum are 
connected by a relation of the form 





6 (t) e» r$ (c) + 1/jo (2.43) 





The presence of a delta-singularity in this spectrum at o = 0 is an 
indication that this signal contains a constant term equal to 1/2. 

The spectrum of radio pulses. As will be recalled, a radio pulse 
ur(t) can be defined as the product of a video pulse uy (t), which acts 
as the envelope, and a nonintegrable harmonic oscillation: 


ur (t) = uy(t)cos (Wot + Po) (2.44) 


In finding the spectrum of a radio pulse, we assume to know the 
function S,(@), which is the spectrum of its envelope. The spectrum 
of a cosine signal with an arbitrary initial phase is obtained by 
generalizing Eq. (2.40): 
cos (Wot + 9o) <> n [6(o — Wo) exp (99) 


+ 8(@ + @p) exp( — jo) ] (2.45) 
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(2.43) is sometimes 
written with only the 
second term 


A 
Solve Problem 16 
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The spectrum of a radio pulse is the convolution of the spectra of 
two signals, uy(t) and cos(©ọt + 99): 


S:(0)= J So- DIBE- oep Go) 
+5 oy exp(—jPo)] dé 


Recalling the filtering properties of the delta function, we obtain 


1 1 
S:(@)= UE (99) Sv (o — Mo) + zP. — Jo) Sv (© + Wo) (2.46) 





The manner in which the spectrum of a video pulse is transfor- 
med when it is multiplied by an r.f. harmonic oscillation is illustrat- 
ed in Fig. 2.9. 

Thus, in spectral terms the change-over from a video pulse to 
a radio pulse implies the translation of the spectrum of the video 
pulse into the r.f. range. Instead of one maximum at @=0, the 
spectrum displays two maxima at o = +@, which are halved in 
absolute value. 


Is 


(a) (b) 


Fig. 2.9 Frequency dependence of the magnitude of the spectrum: (a) for 
a video pulse; (b) for a radio pulse 


It is to be noted that the plots in Fig. 2.9 apply to the case where 
the frequency o, is substantially higher than the effective bandwidth 
of the video pulse. (Precisely this case is usually realized in 
practice.) As is seen, there is no noticeable overlap between the 
spectra for positive and negative frequencies. However, it may so 
happen that the bandwidth of the video pulse is so broad (in the 
case of a short pulse) that the selected value of frequency o is not 
sufficient to avoid overlapping. In consequence, the spectra of the 
video pulse and of the radio pulse cease to be similar in shape. 





Example 2.3. Find the spectrum of a rectangular radio pulse. 
For simplicity, we set the initial phase in (2.44) equal to zero. 
Then the mathematical model of the radio pulse takes the form 


ur (t) — U [o (t) — o (t — tp)] cos oot 
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Knowing the spectrum of the corresponding video pulse, Eq. 
(2.20), and using Eq. (2.46), we find the sought spectrum 





(o — O0) Tp s (o + Oo) tp 


Up 3 2 
_ UT 
Sr(o) = 2 | (o — 65) tp t (© + @0) Tp | ee) 


2 2 


The results found by Eq. (2.47) for two typical cases are shown in 
Fig. 2.10. In the first case, the envelope encompasses 10 cycles of 
the r. f. carrier (®oTp = 207), and the frequency o, is sufficiently high 
to avoid any overlap. In the second case, there is only one cycle of 
the r.f. carrier (@ptp = 2m). Due to the superposition of the positive 
and negative frequency components, the spectrum of the radio pulse 
has the characteristic asymmetrical lobed structure. 








Sr 







{fw 





—wo Ü Wo 
(a) (5) 


Fig. 2.40 Spectra of a radio pulse with a rectangular envelope: (a) for 
Qty = 207; (b) for Tp — 2x 





2.5 The Laplace Transform 


In addition to Fourier transforms, communication theory widely 
uses another class of integral transforms to tackle a large variety of 
problems arising in the study of signals. They are Laplace 
transforms. 

The concept of complex frequency. As we have seen, signal 
analysis by spectral methods is based on the fact that the signal of 
interest is represented as a sum of an infinitely large number of 
elementary components each of which varies in time as exp(jot). 

A natural generalization of the principle consists in that complex 
exponential signals with imaginary exponents are replaced with 
exponential signals of the form exp(pt), where p is a complex 
number such that 


p-o-cjo e 


known as the complex frequency. The complex frequen- 
Any two of such complex signals can always be combined to cy 


68 


Part One. Signals 


produce a real signal by, say, the following rule: 


1 
s(t) == [exp(pr) + exp(p*n] (2.48) 
where 
p*=0 -jo 


is the complex conjugate of p. To demonstrate, 
exp (jot) + exp( — jot) 


s(t) = exp (ot) 5 


= exp(ot)cos ot (2.49) 


A large variety of real signals can be derived, depending on the 
choice of the real and imaginary parts of the complex frequency. 
For example, if o —0, but œ #0, we obtain the usual harmonic 
oscillations of the form cos ot. If, on the other hand, o — 0, we will 
obtain exponential oscillations either building up or decaying with 
time, depending on the sign of c. More complex signal waveforms 
arise when œ #0. Now, the factor exp(ot) plays the part of the 


6<0,w=0 670,070 


| t | | \ | t 
6>0,w=0 - 6<0,w#0 
t t 


Fig. 2.11 Real signals corresponding to various values of the complex 
frequency 





envelope exponentially varying with time. Some of the most typical 
signals are shown in Fig. 2.11. 

The introduction of complex frequency is very fruitful above all 
because we can, without resorting to generalized functions, obtain 
the spectral representations of signals whose mathematical models 
are nonintegrable. More importantly, exponential signals of the 
form defined in Eq. (2.49) provide a “natural” means for studying 
signals in various linear systems. This matter will be taken up in 
detail in Chap. 8. 

It is to be noted that the true physical frequency acts as the 
imaginary part of the complex frequency. 


Ch. 2 Spectral Representations of Signals 
Basic relations. Let f(t) be a signal, real or complex, defined at 


t>0 and identically equal to zero at negative values of time. The 
Laplace transform, F (p), of this signal is defined by the integral 


F (p)= J f(t)exp(— pt)dt (2.50) 





The signal f(t) is the original time function, and the function F (p) 
is its Laplace transform. 

The condition for the integral in (2.50) to exist consists in the 
following: The signal f(t) may not grow faster than exponentially at 
t>0, that is, it must satisfy the inequality 


|/(0) | € kexp (at) (2.51) 


where k and a are positive numbers. 

When the above inequality is satisfied, the function F (p) exists in 
the sense that the integral in (2.50) absolutely converges for all 
complex numbers p for which Re (p) > a. The number a is called the 
abscissa of absolute convergence. 

The variable p in the basic formula (2.50) may be identified with 
the complex frequency p= o + jo. Indeed, in the case of a purely 
imaginary complex frequency when o — 0, Eq. (2.50) goes into Eq. 
(2.16) defining the Fourier transform of a signal which vanishes at 
t « 0. Thus, the Laplace transformation should be looked upon as 
a generalization of the Fourier transformation to complex fre- 
quencies. ` 

As with Fourier transforms, if we know a Laplace transform, we 
can recover the corresponding original time function. For this 
purpose, in the Fourier inversion formula 


f(t) 


N 


T f F(@)exp(jat)da 

we should perform an analytic continuation by changing from the 
imaginary variable jo to the complex argument (o + jo) On the 
complex-frequency plane, it is usual to carry out integration along 
an infinitely extended vertical axis located to the right of the 
abscissa of absolute convergence. Since at o = const the differential 
do = (1/j)dp, the inverse Laplace transform takes the form 


cTjoo 


O= f F(p)exp(pt)dp (2.52) 


LN c—ju 
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In the theory of functions of a complex variable it is shown that 
Laplace transforms are well-behaved in terms of smoothness; they 
are analytic at all points on the complex p-plane, except the 
countable set of so-called singular points. The singular points are, 
as a rule, poles, single or repeated. Integrals of the form (2.52) can 
be evaluated by the techniques used in the theory of residues [11]. 

The Laplace transform and the inverse Laplace transform are 
referred to as a Laplace transform pair. In practice it is often 
convenient to look up each if the other is known in a set of tables. 
One such table is given in Appendix 4. It permits handling 
a sufficiently wide range of problems. 

Examples of finding Laplace transforms. The calculation of 
Laplace transforms has much in common with finding Fourier 
transforms examined previously. Therefore, we shall limit ourselves 
to the most typical cases. 





Example 2.4. The Laplace transform of a generalized exponential 


pulse. 
Let 


f(t) = exp(pot)o (t) 
where 


Po = 99 t JM 


is a fixed complex number. Owing to the presence of the o- 
function, f(t)=0 at t « 0. Using Eq. (2.50), we get 


F(p)= f exp[ — (p- poi]dt- — 
0 


exp[ - (P — pot] |” 
P— Po 0 


If Re p> o,, then, on substituting the upper limit, the numerator 
vanishes, and we get the following correspondence 





exp (pot)o(t) 21/(p — po) 


(2.53) 


As a special case of Eq. (2.53, we can obtain the Laplace 
transform of a real exponential video pulse: 


exp( — at) o(t) 2 1/(p - o.) (2.54) 





and of a complex exponential signal: 


exp (Jot) o(t) — 1/(p — joo) (2.55) 


Finally, on setting «=0 in Eq. (2.54), we obtain the Laplace 


0 


The 6-impulse belongs 
to the region ¢>0 
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transform of the Heaviside function: 
c(t) =1/p (2.56) 


Example 2.5. The Laplace transform of the delta function. 
If the 5-impulse occurs at time tọ >0, we need to evaluate the 
integral 


J S(t — to)exp( — pt)dt = exp(— pto) 

0 

Then the Laplace transform of the delta function takes the form 
8(t — to) 2exp( — pto) (2.57) 


The Laplace transform in (2.57) is defined at all points on the 
complex p-plane. It has singularities nowhere except at infinity. 

A certain difficulty may arise in taking the Laplace transform of 
the ó-impulse concentrated at t — 0, because it is not clear how we 
should treat the contribution from the generalized function 
concentrated at one of the ends of the range of integration. The 
point is that the delta function (see Ch. 1) is defined as the limit of 
a sequence of pulses, symmetrical about t — 0. If we proceed from 
formal considerations, then only a half of the pulse will fall within 
the range of integration, and this will result in halving the magni- 
tude of the integral. To avoid this, the Laplace transform of 8(t) is 
defined as the limit 


lim f &(fexp(— pt)dt=1 
€+-0 O-E 

independent of the parameter s. With this approach, the delta 
function always belongs to the region of integration and has 
a Laplace transform of unit: 


8(t) =1. (2.58) 








2.6 Basic Properties of the Laplace Transform 


Most properties of the Laplace transform are the same as the 
analogous properties of the Fourier transform. Therefore, in the 
subsequent discussion we will supply a proof only where the need 


to do so arises. 


Linearity. The Laplace transformation is a linear integral 
transformation. Therefore, the weighted sum of signals is transform- 
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ed as follows: 





D rifit) =} riFi(p) (2.59) 





On the strength of this property, it is an easy matter to take the 
Laplace transforms of signals which may be represented as sums of 
relatively simple components for which the Laplace transforms are 
already known. For example, using Euler's formula and considering 
the Laplace transform pair in (2.55), we find that 





cos Mpto(t) = p/(p? + ox) (2.60) 





sin aytc(r) = @o/(p? + ag) (2.61) 





The Laplace transform of a signal translated in time. If 
f(t) =F(p) 
we may write 
f (t— to) =exp(— pto) F (p) (2.62) 


As an example, let us take the Laplace transform of a rectangular 
video pulse of unit amplitude and of duration tp, which occurs at 
t — 0. It will suffice to note that this pulse is the difference of two 
switching functions translated in time by tp. Using Eq. (2.56), we 
obtain 


f(t) 2ü/p[1-— exp(— pxp)] (2.63) 


The shifting theorem. Basically, it runs as follows: If f (t) =F (p), 
the Laplace transform of a signal multiplied by an exponential 
function of time is obtained by shifting the argument of the Laplace 
transform: 


f (Dexp(— at) =F (p+ a) (2.64) 


The theorem is proved by the direct substitution of the function 
f(Dexp( — at) in (2.50). 

By virtue of this property, we can, for example, take the Laplace 
transforms of exponential signals with a harmonic carrier. Thus, on 
the basis of (2.60) and (2.61), we get 


pta 


-—— ——c- 2.65 
(p - a +o? 285) 


exp(—at)cos@pt = 
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Do 


a= 2.66 
(p +a)? +05 E 


exp( — at) sin Oot = 


The Laplace transform of the derivatives of a signal. The Laplace 
transform of the first derivative of a signal is taken by integration 
by parts 
dí F 


di = ! (df/dt)exp( — pt)dt 
=f (t)exp( — pt) | +p [f (Dexp( — pede 
0 0 


It is easy to see that the Laplace transform of the derivative 
contains the value of the signal at the initial point: 





df/dt = pF (p) — f (0) (2.67) 





The Laplace transform of the nth derivative is found by induction 
d'fjat" = p" F (p) — p" ~ FO) — p" ~ ?f'(0) — ... 
=H 9) rn gj (2.68) 
Since Laplace transforms contain the initial state of the signal at 
t —0, we may use the Laplace transformation to solve linear 
differential equations with known initial conditions [11]. 


The Laplace transform of an integral. If the signal is zero at 
t = 0, then 


t 


[/(&)d& — F(py/p ‘ (2.69) 
0 





As an example of the above rule, let us take the Laplace 
transform of a ramp function: 


f(t) 2 to (t) 
To begin with, it is to be noted that f(t) is the integral of the 
switching function 


to (1) = [o (5) d$ 


Since 

c(t) =1/p 

it follows then that 

to(t) =1/p? (2.70) 
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The Laplace transform of the convolution of two signals. 
Similarly to the Fourier transform, the Laplace transform has the 
following property: There is a one-to-one correspondence between 
the convolution of two signals and the product of their Laplace 
P transforms: 
Solve Problem 11 fL («f (t) =F, (p)F.(p) (2.71) 
where 
t 
A, (0f; (t) = ff. (t — 9f, (6) dé 
0 
The above relation provides a convenient means for taking the 
Laplace transform of a signal which may be factored, that is, 
represented by the product of two signals with known Laplace 
transforms. _ 

Relationship between the limiting values of Laplace transforms 
and the original time functions. Let F(p) be the Laplace transform 
of the time function f(t). Then the following statement is valid: The 
behaviour of the Laplace transform near the origin of the 
coordinate system of the complex p-plane determines the nature of 
the original time function in the limit t — oo: 

lim p F (p) = lim f(t) (2.72) 
poo to 
If the signal f(t) does not contain delta singularities at zero, the 
formula 
lim pF (p) = f(0) (2.73) 
poo 
also holds. 
Summary 
$$ The spectral representation of a signal is its decomposition into a sum (which may be 
finite or infinite) of elementary harmonic signals differing in frequency. 
<*> A periodic signal can be represented by a Fourier series which is formed, generally 
speaking, by adding together an infinite number of harmonics at frequencies which are 
multiples of the fundamental repetition frequency of the signal sequence. 
<> The spectral representation of a nonperiodic (notably, pulse) signal is accomplished 
by expanding it into a Fourier integral. 
<< In the frequency domain, a signal is characterized by its spectrum. 
<*> A signal and its spectrum are uniquely related by a Fourier transform pair. 
<*> For the spectrum to exist in the classical sense, it is essential that the corresponding 
signal be absolutely integrable. 
<<? The spectrum of a nonintegrable signal contains a singularity of the delta-function 
type. 
<< Exponential variations in the amplitude of oscillations with time are described in 


terms of complex frequency. 
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4X» The introduction of complex frequency in the Fourier transform results in a new type 


of integral transformation called the Laplace transform. 


4X» Signals to which the Laplace transformation is applicable must be zero at t «O0. 


Review Questions 


1: 


2. 


— 


—_ — — 
WN 


14. 


15. 
16. 


SOBA AAAwW 


Why does the simple harmonic oscillation cos(@gt + @ 9) play an especially important 
role in communication engineering? 

State the exact definition of a periodic signal. Name several physical processes for 
which the periodic signal model offers a sufficiently accurate representation. 


. Define the cut-off angle of a harmonic oscillation. 
. Define the concept of negative frequency. Explain its meaning. 


What is the effect of coherent addition in the case of harmonic oscillations? 
What properties should the spectrum of a real signal possess? 

What is the practical limit for the duration of pulse signals? 

What is a distinction of the spectrum of the 6-impulse? 

How are the duration of a pulse and its bandwidth related? 


. How are the differentiation and integration of a signal represented in the frequency 


domain? 


. How are the spectra of a video pulse and of a radio pulse related? 
. What is the object of introducing the concept of complex frequency? 
. Describe the effect produced by the overlap of the frequency intervals in the spectrum of 


a radio pulse. 

State the conditions that a signal should satisfy in order that its Laplace transform can 
be taken. 

How is the Laplace transform of the product of two signals taken? 

If we know the Laplace transform of a signal how can we predict the asymptotic 
behaviour of the signal in the limit t— oc? 


Problems 


1. Show that the Fourier series of the 2. Find the amplitude coefficient of the 


sawtooth waveform shown in the figure 25th harmonic of a sawtooth signal, if A = 


is given by the formula 


= 30 V. 

3. Show that if a periodic sequence is 
formed by the repetition of a pulse sj (t) of 
known spectrum S,(), the complex 
amplitude of the nth member of the Fourier 
series is 
Cy = (2/T) So (no) 





0 2n 4n 


s(t) = (4/2) — (A/n) [sin œt where T' is the period of the sequence. 


4. Given: a two-sided exponential video 


+ (sin2,£)/2 NS 


+ (sin3 9,£)/3 + ...] s(t) 2 Ugexp( — altl) 
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To find: An expression for its spectrum. 
Determine the duration and bandwidth of 
the signal. 

5. Calculate the spectrum of the 
exponential video pulse defined in Eq. (2.21) 
with an amplitude of 20 V and a parameter 
x — 108 s^! at a frequency 


@)=2 x I0 s^ !* 


6. At what frequency will the spectrum of 
the pulse in Problem 5 have a phase angle 
of — 45°? 

7. Verify that the spectrum of the single 
cosine pulse shown in the accompanying 
figure 


and defined as 
0, t<t, 
Acos ool, tı «t«t; 


s(07] 0, t>t, 


can be found by the formula 





T (Wo + 0) 

209 
S(@)=A 
Wp + 0 
. R(Gg — 0) 
sin— 5 — - 
i | 
8. Find the spectrum of a train of 


n identical video pulses, as shown in the 
accompanying figure: 


* [n this text the unit of angular frequency is 
taken to be second ' [s ‘|~Trans- 
lator's note. 





Show that the spectrum of the train is 
— exp [ —j(n 4 1)oT] 
1 — exp( — joT) 





1 
Sz(@) = S, (o) 


where S,(@) is the spectrum of a single 
pulse. 

Hint: Use the formula for the summation 
of a geometrical progression 

n . l e yt 1 


9. The train consists of three identical 
6-impulses as shown in the figure 


b(t) 


-T 0 T 


Show that the frequency dependence of the 
magnitude of the spectrum of the train is 
given by the formula 


| Sz(0) | = [( + cos o T+ cos20TY 
+ (sinoT--sin20T)]'? 
10. The accompanying figure shows the 


waveform of a pulse signal formed by 
segments of a harmonic oscillation. 


u 


Prove that the spectrum of the signal is zero 
both at the zeroth frequency and at the 
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carrier frequency. How will the spectrum of 
the signal change, if its waveform is 


u 


f | 


11. Using the convolution theorem, find 
the signal for which the Laplace transform is 


F(p) = Uo/(p + o9(p + P) 


Advanced Problems 


12. Let there be a periodic signal 
described by a time function with jumps in 
level (discontinuities of the 1st kind). Show 
that, as their order increases, the Fourier 
coefficients of the signal have an asymptotic 
behaviour of the form O (1/n), irrespective of 
the form of the function. 

13. Assuming the conditions of the 
previous problem, consider a signal in which 


the first derivative experiences 
discontinuities, whereas the function is 
continuous. Show that the Fourier 


coefficients have an asymptotic behaviour of 
the form O (1/n?). 
14. Discuss the following “paradox”: If 


we close for some time the switch in the 
circuit shown in the accompanying figure 


————Ó 
R |^ UR 
LII 49 t 


a rectangular pulse ug(t) will develop across 
the load resistor. This pulse is a sum of the 
harmonic components existing at all times, 
including the time prior to the occurrence of 
the pulse. How does this agree with the 
assumption that no pulse may be produced 
although the harmonic components exist 
already? 

15. Using the Fourier transform, find the 
integral representation for the derivatives of 
any order of the delta function. 

16. Show that the spectrum of the 
o-function (see Eq. (2.43), when it is 
represented by the inverse Fourier 
transform, yields at time t=0 a signal o (0) 
whose value is 1/2. 

Hint: Take the frequency o as a complex 
variable and evaluate the integral 


] S . 
e d [18 (@) + 1/jo] do 


by the theory of residues. 


Chapter 3 


Power Spectra of Signals. 
Principles of Correlation Analysis 


The representation of signals in terms of their spectra markedly 
simplifies the computation of signal energy and, what is more 
important, makes it possible to interpret the results in an 
easy-to-grasp form. These physical ideas are useful in various 
theoretical and applied fields of telecommunications. This chapter 
will examine the relations between the spectral and power 
characteristics of signals. 


3.1 Cross-Spectral Density. Power Spectrum 


In Chap. 1 we have introduced a fundamental characteristic of 
a system of two signals, u(t) and v(t), -their scalar product 
(u, v)= f u(t)o(t)dt (3.1) 


ap 


which is proportional to the cross energy of the signals. If the 
signals are identically the same, u(t)= v(t), their scalar product 
changes to the signal energy 


E,—(u, u)= f u?(t)dt (3.2) 

Let us establish the relation between the scalar product of signals 
and their spectra. 

The generalized Rayleigh formula. Assume that the two signals, 
u(t) and v(t), appearing in Eq. (3.1) are defined in terms of their 
spectra 
ut) = f S,(@)exp lot) do 

(3.3) 
1 % 
v(t)= — f S,()exp (jot) do 
2n a 


On substituting v(t) from (3.3) into (3.1) and reversing the order 
of integration with respect to time and frequency, we get 


(u, v)= x j doS, (o) i u(t) exp (jot)dt 


Note that the inner integral in the last equation is the spectrum 
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of the signal u(t) as found for the negative value of the argu- 
ment: 


f u(t)exp (jat)dt = S,(— o) 

In our further discussion we shall assume that the signals in 
question are described by real functions of time. Then, as is easy to 
see, 





f. S(o) S (o)do (3.4) 


The above relation is called the generalized Rayleigh formula. It can 
be interpreted in a form which is easy to memorize: The scalar 
product of two signals is proportional to the scalar product of their 
spectra. 

Of course, the order of complex conjugation in Eq. (3.4) may be 
reversed to give 


(u, go f Su (0) Sž (o)do (3.5) 
2n a 


In the general case, the integrands in Eqs. (3.4) and (3.5) are 
complex, although the left-hand sides of the equalities are known to 
be real. The two equations can be re-arranged so that the real 
function of frequency appears under the integral. The point is that 
the integration is carried out between symmetrical limits and the 
integrands corresponding, to two symmetrical points, +, are 
complex conjugates. To demonstrate, 


Su( — 9) S$( — ©) = SU) Sv(@) = [Su(@) $5 (0)]* 
Since for any complex number z 

z 4 z* =2Rez 

we may introduce a real function 


Wa) = Re [Su (0) S4 (0)] (3.6) 


in terms of which the scalar product of the signals u and v may be 
written as follows: 


Í 30 
Ei J Ww (o) do (3.7) 
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J. W. Strutt (Lord 
Rayleigh, 1842-1919), 
an outstanding British 
physicist known for his 
work on the theory of 
waves and oscillations 


This is also known as 
Parseval’s relation 
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The cross-power spect- 
rum 


80 





The amplitude respo- 
nse of an orthogonali- 
zing filter as a function 
of frequency 
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The function W,,(@) is termed the cross-power spectrum* of the 
signals u and v. 

Equation (3.7) gives a deeper insight into the fine structure of the 
relation between the two signals. For one thing the various portions 
of their spectra contribute, in the general case, differently to the 
cross-power of the signals. The contribution is a maximum from the 
frequency intervals where the spectra overlap. For another, the 
generalized Rayleigh formula (3.7) suggests how the association 
between the signals can be minimized so that they become ortho- 
gonal in the limit. To achieve this, one of the signals must be 
matched to a special physical system called the frequency filter. This 
filter is to meet the following requirement: It may not pass those of 
the spectral components of the signal which lie within the frequency 
interval where the cross-power spectrum is a maximum. The fre- 
quency response of this orthogonalizing filter has a sharply defined 
minimum within that frequency interval. 

The above approach to finding the scalar product, based on the 
concept of the cross-power spectrum, is directly related to the 
results obtained in Chap. 1, when we found the scalar product of 
signals expanded in terms of orthogonal basis elments. The 
difference is that now we use the continuous rather than discrete 
Fourier presentation. 





Example 3.1. The cross-power spectrum of two exponential video 1 
pulses of the same waveform, separated by a time interval to. 
Assuming that the two pulses have the same amplitude, their v(t) 


spectra may be written as follows: 


u(t) = exp( — at)o(t) 


© Su(@) = 1/(o + jo) 


v(t)=exp[ — a(t — to) ] o (t — to) > S; (o) 


= exp( — joto)/(a + jo) 


Then we find the product of the spectra: 


Su (0) S$ (0) = exp (joto)/(? + e?) 





* Some authors (e.g. A. Breipohl, Probabilistic Systems Analysis) call it 
the cross-power density spectrum. Others (Middleton [20]) call it the 
cross-spectral density.- Translator's note. 


- 


Orthogonalization of 
pulses 
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and, finally, the cross-power spectrum 
Wy, (0) = cos oto/(a^ + œ?) (3.8) 


If we assign a fixed value to the parameter « which defines the 
waveform of the signals, the frequency behaviour of the cross-power 
spectrum will be wholly dependent on the time shift between the 
signals. Two typical plots for the function W,,(@) appear in 
Fig. 3.1. 


uv 





(b) 


Fig. 3.1 Cross-power spectrum of two exponential video pulses: (a) for 
9t,» 1; (b) for aty«1 


Of special interest is the case where the product at, is small, that 
is, when the pulses substantially overlap in time. Equation (3.8) and 
the plot in Fig. 31b show that the cross-power spectrum has 
a well-defined low-frequency character. Hence we may conclude: In 
order to reduce the scalar product of such signals and to make 
them better resolvable, use should be made of a high-pass filter 
which suppresses all frequencies below some limiting, or cut-off, fre- 
quency, We. 

Due to the action of a high-pass filter, the rapidly changing 
leading edge of the output pulse is produced by the high-frequency 
spectral components which are free to pass through. At the same 
time, the low-frequency components are filtered out and the 
duration of the output pulse is reduced substantially. As a result, 
the overlap of the pulses can be made as small as we like, and the 
pulses appearing at the output of the high-pass filter are orthogonal 
very nearly. 








The power spectrum of a signal. The spectral representation of 


signal power can readily be developed as a special case of the 
generalized Rayleigh formula, if we deem the signals u(t) and v(t) to 
be the same. Then Eq. (3.6) defining the cross-power spectrum takes 
the form 


W,.(®) = Su(@) S% (0) = | Su() |? (3.9) 
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4 


Part One. Signals 


The quantity W,(@) is called the power spectrum of a signal*. 
Then Eq. (3.7) may be re-written as 


x 1 a 
Ey= J wdt=>— J W.(o)do (3.10) 


The relation defined in Eq. (3.10) is known in various fields of 
physics as the (narrow-sense) Rayleigh formula. It states an 
important result: The energy of any signal may be represented as 
a sum of contributions from various intervals on the frequency axis. 
Each small interval of physical frequencies, Aw, makes 
a contribution to the total signal energy, equal to 


AE, =] (1/7) W,(o)do 


where œ is some interior point in a given frequency interval. 
(Positive frequencies are meant.) 

The approach based on the spectral representation of signal 
energy is relatively simple. Indeed, the energies associated with the 
various intervals on the frequency axis can be added together as 
real numbers. In contrast, the Fourier transform method as applied 
to the signals themselves is based on the fact that the complex 
amplitudes defining the contributions from small frequency 
intervals are added together as complex numbers. 

When we analyse signals on the basis of their power spectra, we 
inevitably lose the information embedded in the phase spectrum 
because the power spectrum, Eq. (3.9), is the square of the magni- 
tude of the spectrum and is independent of its phase. Among other 
things, when presented in terms of power spectra, all signals having 
the same waveform but differing in their position on the time axis 
appear completely identical and undistinguishable. 

Yet, the concept of the power spectrum is very useful in 
estimating the real bandwidth of a signal for engineering purposes. 








u 
Example 3.2. The power spectrum of a rectangular video pulse. U 
To obtain it, we should square the spectrum of (2.20): 
sin? (@tp/2) 
W,,(@) = U^ ——_# 3.11 4 
ul ) Pp (wt p/2)? ( ) t 
0 Tp 


* This quantity is also called the spectral density (Helstrom, Statistical 
Theory of Signal Detection. Oxford: Pergamon Press, 1968), the energy (or 
power) density (D. Middleton, An Introduction to Statistical Communication 
Theory. New York, Toronto, London: McGraw Hill Book Co., Inc., 1960), 
the power density spectrum (Handbook of Automation, Computation and 
Control ed. by Eu. M. Grabbe, S. Ramo, and D. E. Wooldridge. New York: 
John Wiley and Sons, Inc., 1958), the power spectral density (W.C. Lindsey 
and M.K. Simon, Telecommunication Systems Engineering, Englewood 
Cliffs, New Jersey: Prentice-Hall, Inc, 1973) etc. Translators note. 
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Wu(w)/ (U? 1$) 





Fig. 3.2 The normalized power spectrum of a rectangular video pulse as 
a function of the nondimensional frequency variable wt, 


The corresponding plot appears in Fig. 3.2. It is clearly seen that 
the power spectrum of the signal is a maximum in the low-fre- 
quency region. Ás the frequency rises, the contributions from the 
various spectral components show a non-monotonic, oscillatory 
behaviour, but the general trend is the decrease in the power 
spectrum in inverse proportion to the square: 


Ww) = O(1/o?) as o tends to infinity 


(rather than in inverse proportion to the first power, as is the case 
with the spectrum of the signal in question). 

Formula (3.11) can be used to verify the Rayleigh formula. To 
begin with, we readily find the energy of the video pulse in the time 
demain (see Chap. 1): 


Ey, = Utp (3.12) 


In order to find the energy in the frequency domain, we should 
evaluate the integral: 


x 


E, = (U?t}/n) f sa LI 
0 


d 3.13 
o?15/4 a an) 


A simple change of variable leads to Eq. (3.12) at once. 





Energy distribution in the spectrum of a rectangular video pulse. 
It is interesting and, in many applied cases, important to know the 
share of the total energy within one, two, three, etc. lobes of the 
spectral diagram shown in Fig. 3.2. Let Ey denote the energy of 
a rectangular video pulse, contained in a number k of consecutive 
lobes. By the Rayleigh formula, 

kn 
Ey = (2/1) U7 tp f sin? E/E? d£ (3.14) 
0 
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Unfortunately, the above integral cannot be evaluated analytically, 
but can be found by numerical integration. The accompanying 
table, 3-1, gives the share of the total energy in the consecutively 
numbered lobes, as found by calculation. 


Table 3-1 


k 1 2 3 
E/E 0.902 0.950 0.967 


Thus, if we apply a rectangular pulse to an ideal low-pass filter 
which passes uniformly and without attenuation all frequencies 
from 0 to 2n/tp s^! (the boundary of the first lobe), the output 
signal will account for 90.2% of the input energy. 

As already noted, this approach to estimating the actual 
bandwidth of a signal does not give proper insight into the process. 
Among other things, we know nothing about the corruption that 
the signal suffers as it passes through. However, in cases where the 
shape of an oscillation is of secondary importance, and we are, 
above all interested in the magnitude of signal energy (this 
situation is frequently encountered in statistical communication 
theory) the estimation of the bandwidth in terms of energy is 
especially warranted. 

For example, from Table 3-1 it is seen that in going from k—1 
to k= 2 (which implies a two-fold increase in the bandwidth of the 
device through which the signal is passed) the energy of the wanted 
signal increases by a mere 4.8%. On the other hand, it is clear that 
noise, if there is any, may, as a result, double in energy if its power 
spectrum is flat over the frequency band of interest. That is why an 
unwarranted increase in bandwidth must be avoided. 


3.2 Correlation Analysis of Signals 


In the early days of telecommunications, the choice of the best 
signals for specific applications was not critical. For one thing, the 
messages (telegraph signals, radio broadcasts) were simple in struc- 
ture. For another, it was difficult to implement signals of complex 
waveforms and the associated equipment for their coding, 
modulation, demodulation, and decoding. 

Today, the situation is entirely different. In present-day 
telecommunication complexes, the choice of signals is dictated not 
by the technical convenience in their generation, transformation 
and reception, but, above all, by the ability to achieve the goals 
envisaged at the design stage in an optimal manner, that is, with 
the utmost efficacy, using suitable signals. In order to get an idea 
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about how the need arises in signals possessing some predetermined Ed 

properties, let us consider the following example. f, 
Comparison of signals translated in time. Let us turn to / 

a simplified description of how a pulsed radar measures range to / ý 

a target. Here, information about the target is embedded in the / / 

magnitude of t, the time delay between the transmitted pulse and 4 / 

the received echo. Characteristically, both the transmitted signal, jf 

u(t), and the received signal, u(t — 1), have identical waveforms for / $ 

any value of time delay. In block-diagram form, the device designed / 

to process radar signals in order to measure range may look like Fi / 

the one shown in Fig. 3.3. / 


u(t—t) 





e | 


‘om parator 





Fig. 3.3 Set-up for measuring delay time 


The system consists of a set of elements which delay the 
transmitted “reference” signal for fixed time intervals t,, T3, ..., 
ty. The delayed signals are applied together with the received echo 
signal to comparators which generate an output signal only if the 
two input signals are identical. If we know the No. of the channel 
in which this event occurs, we can measure the time delay and, in 
consequence, the range to the target. 

The performance of the device improves progressively with the 
increase in difference between the transmitted signal and its echo 
translated in time. If the difference is negligible, an ambiguous 
indication may will occur, because signals will appear at the out- 
puts of several adjacent comparators at the same time. 

Thus, we have developed a qualitative idea about which signals 
may be taken as “well-behaved” for a given application. 

Now we will pass on to the exact mathematical statement of the 
problem at hand and show that all these matters have a direct 
bearing on the power spectra of signals. 

The autocorrelation function of a signal. In order to evaluate the 
degree of difference between a signal, u(t), and its time-translated 
replica, u(t — t), it is usual to resort to the autocorrelation function 
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K,{t) equal to the scalar product of the two signals: 


K,(t)= f u(t)u(t — t)dt (3.15) 


= of 





In our further discussion, it will be assumed that the signal of 
interest is a pulse localized in time, so the integral of the form in 
(3.15) does exist. 

It follows directly from Eq. (3.15) that at t=O the 
autocorrelation function becomes equal to the signal energy: 


K,(0) = E, (3.16) 


One of the simplest properties of the autocorrelation function is 
that it shows even symmetry: 


Ku(t)= Ky(— 1) (3.17) 


To demonstrate, if in Eq. (3.15) we change the variables, x = t — t, 
then 
o oo 
f u(Qu(t- 9dt— f u(x+t)u(x)dx 

An important property of the autocorrelation function is that 
under any time shift t the magnitude of the autocorrelation function 
does not exceed the signal energy: 


| Ku(t)| < K,(0) = E, (3.18) 


This fact is proved by directly using the Cauchy-Buniakovski 
inequality (about which we have learned in Chap. 1): 


|(u, ux)| < || u ||- || ucl = Eu (3.19) 


To sum up, the autocorrelation function K,(t) is a symmetric 
curve with a central maximum which is always positive. Irrespective 
of the form of the signal u(t) the autocorrelation function may 
display both a monotonically decreasing and an oscillating behavi- 
our. 





Example 3.3. The autocorrelation function of a rectangular video 


pulse. 

Figure 3.4a shows a rectangular video pulse of amplitude U and 
of duration tp. It also shows the signal’s replica translated 
backwards in time for t seconds. The integral of (3.15) is evaluated 
here in a trivial manner, proceeding from a graphical construction. 
To demonstrate, the product u(t)u(t — t) is non-zero only within 
the time interval over which the superposition of the signals is 
observed. From Fig. 3.4a it is seen that this time interval is equal 
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—Tp 0 Tp 
(5) 





Fig. 3.4 Finding the autocorrelation function of a rectangular video pulse 


to tp — |t], if the shift does not exceed the duration of the pulse. 
For the signal in question, 


(yz (E |t|<t 
K,(-4 R m E (3.20) 


Graphically, the function yields a triangle like that shown in 
Fig. 3.4b. The base of the triangle is twice the pulse duration. 
Example 3.4. The autocorrelation function of a rectangular radio 
pulse. 
Consider a radio signal of the form 


0, (t « — Tp/2) 
u(t)= U cosot, (— tp/2 < t < tp/2) 
' l 0, (t > tp/2) 


Since we know that the autocorrelation function has the property 
of even symmetry, we evaluate the integral in (3.15) by assuming 
that O0<t<tp. Then 


Tp/2 
Ku(t)=U? f  cosotcoso(t— x)dt 
= (Tp/2)+T 
tyj2 
= (U?/2) (tp — 1)coset--(U?/2 f | cosQot— x)dt 
-(Tp/2)+T 


The last trigonometric integral is easy to evaluate, and we obtain 
sin 2@ (tp — | 


3.21 
2o (tp — ||) (3.21) 


K,,(t) = (U?/2)(tp — sp osos + 


Naturally, at t=0, K,(0) becomes equal to the energy of the 
pulse (see Example 1.9). Equation (3.21) defines the autocorrelation 
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function of a rectangular radio pulse for all shifts t lying in the 
interval ( — tp <T < tp). Obviously, if the magnitude of the shift 
exceeds the duration of the pulse, the autocorrelation function 
identically reduces to zero. 

The autocorrelation function of the pulse in question has 
a characteristic oscillatory form. 

Example 3.5. The autocorrelation function of a train of rectangular 
video pulses. 

Radar widely uses signals which are trains of identical pulses 
recurring at equal time intervals. The task of detecting such a train 
and of measuring its parameters, such as its time position, is 
accomplished by devices which implement the algorithm for the 
computation of the autocorrelation function of the signal. 

As an example, Fig. 3.5a shows a train of three identical 
rectangular video pulses. It also shows its autocorrelation function 
found by Eq. (3.15) (Fig. 3.50). 





(a) (5) 


Fig. 3.5 (a) A train of three identical video pulses and (b) its 
autocorrelation function 


We omit all computational details because the procedure is 
exactly the same as used in Example 3.3. 

It is well seen that the autocorrelation function has a maximum 
at t=0. However, when the delay time is a multiple of the pulse 
repetition period (t= +T, +2T in our case) the plot of the 
autocorrelation function displays side lobes comparable in height 
with the main lobe. Therefore, we may speak of a certain 
imperfection in the correlation structure of the signal. 


A The autocorrelation function of an unbounded signal. In cases 
involving periodic sequences extended in time without bound, 
Work Problem 8 a somewhat different approach is necessary towards the correlation 
properties of signals. Assume that such a sequence is derived from 
some signal localized in time, that is, a pulse signal, when its 
duration tp goes to infinity. 
To avoid discrepancy in the expressions thus derived, we shall 
define the new autocorrelation function as the mean of the scalar 
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product of the signal and its time-shifted replica: 
Tp/2 
Kyuy()-2 lim — f u(t)u(t — x)dt (3.22) 
Ty TP -1y2 
With this approach, the autocorrelation function K, becomes 
equal to the mean cross power of the two signals. 
If we wish to find this autocorrelation function for a cosine 
waveform unbounded in time 


u(t)= Ucosot, —oo«t«oo 


we may use Eq. (3.21) derived for a radio pulse of duration tp, then 
pass to the limit with tp tending to infinity, and recall the definition 
in (3.22). As a result, we obtain 

K,(1) = (U?/2)cos wt (3.23) 

This autocorrelation function is itself periodic; its value for t = 0, 
equal to U?/2, is the mean (effective) power that a given signal will 
develop across a load resistor of 1 Q. 

Relation between the power spectrum of a signal and its 
autocorrelation function. From the material presented in this 
chapter, the student may think that the methods of correlation 
analysis are only some special techniques which have no direct 
bearing on the principles of a spectral decomposition. It is easy to 
show that there is a close relation between the autocorrelation 
function and the power spectrum of a signal. 

To demonstrate, in accord with Eq. (3.15), the autocorrelation 
function is a scalar product: 


Ky (x) = (u, ur) 
Here ur stands for u(t — t) which is a time-shifted replica of the 
original signal. 

Referring to the generalized Rayleigh formula, Eq. (3.4), we may 
write 


(uu) — 5 J $,6)51,(5)do 


The spectrum of a signal shifted in time is 
Su, = Suexp(— jot) 
Therefore, 
Si, = Sù exp (jot) 


This brings us to an important result: 





K, => f IS, P'exp(jox)do (3.24) 
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As will be recalled, the square of the magnitude of the spectrum 
is the power spectrum of a signal. Thus, the power spectrum is the 
Fourier transform of the autocorrelation function of a signal: 


Ku(t)|Su(@)|? = Wao) (3.25) 


Using Eg. (3.24), we may write the inverse relation 


| Su(@) |? = f Ky(t)exp( — jox)d« (3.26) 





The above expressions are important for two reasons. Firstly, 
they permit us to evaluate the correlation properties of signals from 
the distribution of their power over the spectrum. According to the 
uncertainty principle (see Chap. 2), an increase in the frequency 
band within which the spectral components of a signal are 
distributed produces a narrower main lobe of the autocorrelation 
function and makes the signal more manageable from the 
view-point of measuring the instant when it occurs. Secondly, Eqs. 
(3.24) and (3.26) suggest the way in which the power spectrum of 
a signal can be determined experimentally. Frequently, it is more 
convenient first to find the autocorrelation function, and then to 
derive the power spectrum of a signal from its Fourier transform. 
This procedure is widely used in the analysis of signals with the aid 
of high-speed computers operating in real time. 





Example 3.6. The autocorrelation function of a signal with Wy 
a uniform and band-limited power spectrum. 
Let the signal u(t) be characterized by a power spectrum of the 


form 


j 0, OQ < — Olim 
W,(o)-—* Wo, — Olim € 0 < Olim 
[9 @> tim 


Using Eq. (3.24), we find the autocorrelation function: 


Olim 


K,() =(Wo/2n) J 


— Olim 


Olim 


exp (jat) do 





=(W,/n) | cosetdo 
0 


Wo Olim sin OlimT 


(3.27) 





T OlimT 


Correlation time 
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Thus, the autocorrelation function of the signal in question has 
a lobed structure. 

Frequently, it is convenient to introduce a numerical parameter 
known as the correlation time, tc, which is an estimate of the width 
of the main lobe of the autocorrelation function. It is easy to see 
that in the case at hand the correlation time should be found from 


the relation 
Olim tc = Tt 
Hence, it follows that 


Te = R/Olim = 1/2fiim 


(3.28) 


decreases with an increase in the upper frequency limit of the power 


spectrum of the signal. 





Constraints imposed on the form of the autocorrelation function 
of a signal. From the relation existing between the autocorrelation 
function and the power spectrum of a signal we can establish an 
interesting, but, it seems, not so obvious criterion for the signal to 
have the desired correlation properties. The point is that the power 
spectrum W,(o) of any signal must, by definition, be positive (see 
for example Eq. (3.25)). This condition is not satisfied with just any 
choice of the autocorrelation function. For example, if we choose 


( 0. T< — Te 


and take the Fourier transform, then we shall get 
T, 


[Su]? = 2A J cos otdt = (24/@)sin ote 
0 


This alternating function cannot represent the power spectrum of 
any signal. 


3.3 The Autocorrelation Function of Discrete Signals 


From our discourse on the autocorrelation function of a train of 
rectangular video pulses, the reader has undoubtedly noted that its 
plot has a specific lobed structure. For practical uses of the 
autocorrelation function, such as the detection of this signal or the 
measurement of its parameters it is immaterial that the lobes are 
triangular in shape. What is important is their level as compared 
with the central maximum at t= Q. 

Our immediate task is to modify the autocorrelation function so 
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(a) (c) 


Fig. 3.6 A three-position discrete signal and its realization by variations in 
amplitude and phase: (a) symbolic representation; (b) amplitude coding; (c) 
phase coding 


that we can extract from it all useful information while divorcing 
ourselves from minor details. A convenient basis for this endeavour 
is supplied by the mathematical model of a discrete signal (see 
Chap. 1). 

Representation of composite signals having a discrete structure. 
A train of identical rectangular video pulses is the simplest 
representative of the class of composite signals built in accordance 
with the following principle. The entire interval over which the 
signal exists is divided into a whole number M>1 of equal 
intervals called positions. Within each position the signal may exist 
in any one of two physical states. 

Figure 3.6 explains several ways of forming a multiposition 
composite signal. For definiteness (here and elsewhere) we assume 
that the two possible states of the signal correspond to the numbers 
+1 and - lI. 

As follows from the figure, a discrete signal may take on different 
physical shapes. In the first case (see Fig. 3.6b) the +1 symbol 
corresponds to the positive value, + Uo, of the height of the video 
pulse transmitted in the respective position, whereas the —1 
symbol corresponds to the negative value of the pulse height, 
— Uo. This is the amplitude coding of a discrete signal. 

In the second case (see Fig. 3.6c) the signal is phase-coded. In 
order to transmit the + 1 symbol in the corresponding position, we 
generate a truncated harmonic signal with a particular (say, zero) 
initial phase. In transmitting the — 1 symbol, we utilize a truncated 
sine wave of the same duration and of the same frequency, but with 
the initial phase shifted through 180°. 

Despite the obvious difference between the waveforms of these 
two signals, we can establish a complete identity between them in 
terms of their mathematical models. To demonstrate, the model of 
any such signal is a sequence 


{u,, Uy, 2, UM_1, uM] 


in which each symbol u; takes on one of two possible values, + 1 
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or —1. For convenience, let us agree to stuff the sequence with 
zeros in the positions where the signal is not defined. Then, the 
discrete signal {1, 1, —1, 1} can be written out in full as 


..0 0011 -1100... 


An important operation in processing discrete signals is the shift 
of such a signal through a certain number of positions (digits) 
relative to the original one. In what follows, the first line represents 
the original signal; the second, third and fourth lines represent the 
same signal shifted backwards one, two, and three digits: 


ooo°o 
ooo - 


0 
1 
1 
l 


—m—oo 


0 
0 
0 
1 


oOoocoo 


Í 
| 
Í 
l 


ore — 


I 
I 
0 
0 


OoOo 
DOODO 


The discrete autocorrelation function. Let us generalize Eq. (3.15) 
so that we could determine the discrete counterpart of the 
autocorrelation function applicable to the class of signals in 
question. Obviously, integration should now be replaced with 
summation, and the variable t should be replaced with an integer n, 
positive or negative, which indicates how many positions (digits) the 
replica is shifted relative to the original signal. Recalling that we 
have agreed to stuff “empty” positions with zeros, the discrete 
autocorrelation function may be written as 





C 


K,(n)= È ujuj-n (3.29) 


J= -%0 


This function of a whole-valued argument n extends to the 
discrete case the basic ideas of the scalar product of two signals 
and, quite naturally, possesses many of the already known 
properties of the scalar product and of the continuous 
autocorrelation function. For example, it is easy to see that the 
discrete autocorrelation function shows even symmetry: 


K,(n) = K,( — n) (3.30) 


Under a shift of zero, the discrete autocorrelation function 

reduces to the energy of a discrete signal: 
oO 
K,00- Y uj EE, (3.31) 
j=- x 

Selected examples. To illustrate the foregoing, let us find the 
discrete autocorrelation function of a three-digit signal in which all 
the digits are the same, u= {1, 1, 1}. Let us write this signal along 
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with its replicas shifted one, two and three digits: 
000111000... 
000011100... 
000001110... 
...000000 1 1 I... 


As is seen, even with n — 3 the original signal and its replica do 
not overlap any longer. This implies that the products in Eq. (3.29) 


3 reduce to zero at n 2 3. On taking the sums, we get 
2 2 K,0)=14+1+1=3 
1 1 K,(1)=1+1=2 
| | n  KQ)-1 
-2-1 0 1 2 The side lobes of the autocorrelation function here subside with 


increasing number n in about the same manner as we have seen in 
the case of the autocorrelation function for three continuous video 
pulses. Obviously, one and the same discrete autocorrelation 
function can fit a wide variety of sequences derived from any 
continuous signals, provided the time spacing between the pulses is 
the same. 

Now we consider a discrete signal which differs from the previous 
one in the sign in the second position: 


u={t, — 1,1} 

Proceeding as before, we find the values of the discrete 
autocorrelation function: 
K,)=141+1=3 


K,(1)= —1-1= -2 


K,Q)-1 

It turns out that the first side lobe changes sign, but remains 
unchanged in magnitude. 

Finally, let us consider a three-position discrete signal for which 
the mathematical model is: 





u=({l,1, —1} 
3 Its autocorrelation function is: 
K,()=14+1+1=3 
" i K,()=1-1=0 
Tote], £&o- 
-2-1 0 1 2 Undoubtedly, of the three discrete signals we have just examined, 
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it is the third one that is most favourable in terms of correlation 
properties, because the side lobes of its autocorrelation function 
have the lowest level. 

Barker sequences. In the 50s and 60s, the search for discrete 
signals whose autocorrelation function would have the best struc- 
ture was the object of intensive research by specialists in the fields 
of communication theory and applied mathematics [21]. They have 
found several classes of signals having very good correlation 
properties. Of them, the so-called Barker sequences are most 
known. They possess a unique property: Whatever the number 
M of positions (digits or pulses), their autocorrelation functions, as 
found by Eq. (3.29), do not exceed unit for any n #0. On the other 
hand, their energy, that is, K,(0) is numerically equal to M. 

It has been found that Barker sequences can be realized only if 
the number of digits (that is, the length) is M — 2, 3, 4, 5, 7, 11, or 
13. M = 2 represents a trivial case. The Barker sequence with M = 3 
has just been examined at the end of the previous section. The 
mathematical models of Barker sequences and the corresponding 
autocorrelation functions are summarized in Table 3-2. 


Table 3-2 Barker Sequences 


M Signal model Autocorrelation function 
31,1, -1 3,0, -1 With M -—4, two 
4.151 —1 4, 1,0, -1 forms of signals are 
1,1, —1, 1 4 —1, 0,1 ossible 
51,1, 1, 1,1 50,101 p 
71,1, 1, —1, 1,1, —1 7,0, —1, 0, —1, 0, -1 
HLG 1, —1, —1, 11, 0, —1,0, — 1, 0, — 1, 
1, —1, -1,1, -1 å 0 —1, 0, — i 
13 1, 1, 1, 1, 1, — 1, — tł, 13, 0, 1, 0, 1, 0, 1, 0, 
LI Shel. S11 1, 0, 1, 0, 1 


13 


4 1 
) Lolli ole f lle 


-12-10-8-6-4-20 2 4 6 


RAMIS dal. j 


(b) 





Fig. 3.7 Barker sequences for M = 13: (a) amplitude coding; (b) phase 
coding; (c) autocorrelation function 
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As an illustration, Fig. 3.7 shows the form of the most commonly 
used 13-digit Barker sequence and two coding methods along with 
a plot of its autocorrelation function. 

As investigations have shown, Barker sequences with an odd 
number of digits exceeding 13 are non-existent. It remains 
unknown, however, whether we can build a Barker sequence with 
an even M greater than four. 

In conclusion, it should be noted that in this chapter we have 
examined some properties of discrete signals and of their 
autocorrelation functions by way of an introduction. A systematic 
exposition of the material will be given in Chap. 15. 


3.4 The Cross-Correlation Function of Two Signals 


In some theoretical and applied problems of telecommunications 
it is convenient to introduce a special characteristic of a two-signal 
system, the cross-correlation function between the signals involved. 
It describes in a unified manner both the difference in shape and 
the relative position of the signals on the time axis. 

Determination of the cross-correlation function. By generalizing 
Eq. (3.15), let us call the cross-correlation function between two 
real signals, u(t) and v(t), the scalar product of the form 

oo 


Kw(t)= f u(t)o(t—1)dt (3.32) 


The usefulness of this integral characteristic of signals will be 
seen from the following example. Let, for instance, the signals u(t) 
and v(t) be orthogonal in their original state, so that 

f u(t)o(t)dt=0 


- oo 


As they pass through a device, the signal u(t) may lead or lag 
behind the signal v(t) by a time interval t. Obviously, the 
cross-correlation function Kyy,(t) is a measure of how “stable” the 
orthogonal state of the signals is under the time shift. 

Some properties of the cross-correlation function. If in Eq. (3.32) 
we change the variable of integration & = t — t, such that dt — dé, 
the cross-correlation function may obviously be re-written thus: 

W 


Kw(t)= J u(+t)v@)dé (3.33) 


The reason why the results found by Eqs. (3.32) and (3.33) are 
the same is clear: The signals u(t) and v(t) will take up the same 
relative position, whether we shift the signal v(t) backwards or 
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advance the signal u(t) by the same amount c. Therefore, 
Kwo(t) = Krul- 1) (3.34) 
In contrast to the autocorrelation function of one signal, the 


cross-correlation function between two signals does not show even 
symmetry about the argument t: 


Kuv(t) Æ Kuv( = T) 


If we consider signals of finite energy, we will see that the 
cross-correlation function is bounded. This statement follows from 
the Cauchy-Buniakovski inequality: 


| Kw(9)] = | (u, v:)} < || ul-I vell 
Hence, 
| Ku(t)| < || ullo |l (3.35) 


because the shift in time does not affect the norm of the signal. It 
should be noted that at t= O the cross-correlation function need 
not reach an absolute maximum. 


exist over a common time interval [0, T]. 





u(t)=U and v(t)= Ut/T 


For (0<t<T), the signals can be written: 
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Example 3.7. Calculate the cross-correlation function K, (x). 
The signal u(t) is a rectangular video pulse, and the signal 
v (t) is a triangular video pulse. They have the same amplitude, U, and 
the same duration, T. Originally (in the absence of delay), the signals 


If t>0, that is, if the signal v(t) lags behind the signal u(t), then 


T 
Kuo(t) = (U?/T)f —t)dt 


out simple manipulations, we get 





BD T t Ku()= UT (5 ey) for v» 0 (3.36) 
01 T 2 2 
Case 1 70 If, on the other hand, t <0, that is, the triangular pulse leads the 
rectangular pulse, then 
T= Tl 
(3.37) 


Kw(t)=(U?/T) f. (¢—|t|)dt=(U?T/2)(01 — n’) 
0 


On introducing a dimensionless parameter n = 1/T and carrying 


The cross-correlation function as found by Eqs. (3.36) and (3.37) 
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Kyy/(U?T) 






1 
= 0 l 


Fig. 3.8 A plot of the cross-correlation function between a rectangular and 
a triangular pulse 


is shown diagrammatically in Fig. 3.8. The plot is asymmetrical, 
because the overlapping area of the two pulses varies at a different 


0 T-|*| 


Case 1«0 


T 


rate, depending on the direction of the time shift. 








Relation to the cross-power spectrum. Let us express the 
cross-correlation function between two signals in terms of their 
spectra. In doing this, we will apply the same reasoning as in the 
spectral representation of the autocorrelation function. On the basis 
of the generalized Rayleigh formula 


Kyo (t) = (u, v.) = (1/20) f S, (0) $5 (o) do 


Since the spectrum of the time-shifted signal is 
Sv. (o) = S, (o)exp( — j ox) 
it follows that 


oo 


Kuv(t) = (1/2x) í Su(@) Sž (o)exp(j aox)do (3.38) 


Recalling that 
‘uv(t) = Su (0) Sf (e) (3.39) 


is the cross-power spectrum of the signals u(t) and v(t), defined 
over an infinite frequency interval — oo < o < oo, we may draw the 
following conclusion: The cross-correlation function of two signals is 
the Fourier transform of their cross-power spectrum, and vice 
versa. 

Interestingly, in contrast to the power spectrum of a single signal, 
the cross-power spectrum contains some information about the 
phase of the spectral components at different frequencies. Thus, if 
the signal spectra are 


Su(@) = | Su (Œ) lexpj Yu (©) 
S (Œ) = | S,(@) | expj V (o) 
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then, on the basis of Eq. (3.39), the argument of the cross-power 
spectrum is defined in terms of the difference between the 
arguments of the spectra of the signals: 


Wav (©) = | Su() | x | Sy (o) | exp U [Wu (6) — Wo (@)]} 


Generalization to the discrete case. Let the signals u(t) and v(t) 
be specified in discrete form as sets of samples 


Hf np Mags Ug, Wis Ug, a=} 
v={..., 0.4, vg, 94, U5, ...]) 
recurring at equal intervals T. By analogy with the autocorrelation 


function of a single signal, the cross-correlation function of two 
discrete signals may be defined by the formula 


oO 
Kw (n) = ! X ujUj—-n (3.40) 
j=-@ 


where n is an integer, positive, negative or zero. 
We will demonstrate how this function is calculated, using as an 
example two four-digit Barker sequences 


u- (1,1,1, —1} 
v= {1,1, — 1,1} 


If n> 0, the signal v lags behind the signal u. Proceeding as in 
the previous section, we compile a table of the signal u and a set of 
time-shifted replicas of the signal v: 


..000011 1-1 0 0000... 
..000011 -1 1 0 0000.. 


..000001 1-1 1 0000.. 
..000000 1i 1-1 1000. 
..000000 0 | 1-119090... 
Using Eq. (3.40), we obtain 

Rup(0) - 0 

Ra (1)7 3 

Kw(2)=0 

Kw(3)= -1 


A similar table can be compiled with the signal v(t) shifted so 
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that it leads the signal u(t): 

..000011 1-1 0 OO... 
..000011-1 1 O0 00. 
..000 1| 1-110009... 
..001 1-1 100000... 
-f ..011-—-1 1 000000... 


Then, 

Kw(—1)=1 
Kuy( —2)=0 
Kyw(—3)=1 


The plot of the cross-correlation function of these two signals has 
a sharply asymmetric shape: the cross-correlation function is at 
a maximum when the signal v(t) is shifted one digit backwards. 


Summary 

<The scalar product of two signals may be expressed as the scalar product of their 
spectra (the generalized Rayleigh formula). 

Q€ The distribution of the cross power over a frequency range is described by the 
cross-power spectrum of the two signals involved. 

4X An approximate orthogonality of signals can be achieved by filtering out appropriate 
spectral components. 

<> From the distribution of the signal energy over the entire infinite frequency interval it 
is seen that its power spectrum is equal to the square of the magnitude of its 
spectrum. 

4$ The degree of semblance between a signal and its time-shifted replica is described by 
the autocorrelation function of that signal. 

<> The power spectrum and the autocorrelation function of a signal are related by 
a Fourier transform pair. 

<> The notion of the autocorrelation function can be extended to the case of 
multiposition (multidigit) discrete signals. 

Q^ It is taken that a signal has good correlation properties if the side lobes of its 
autocorrelation function are substantially smaller than the main lobe. 

© The cross-correlation function of two signals is the Fourier transform of their 


cross-power spectrum. 


Review Questions 


1. What is the physical meaning of the cross-power spectrum of two signals? 
2. Name the conditions that should be satisfied by the function describing the cross-power 


spectrum of two signals so that the signals involved could be orthogonal. 
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3. Is it possible to realize a situation in which the spectra of two signals overlap, but the 
signals remain orthogonal? 

4. Is the phase of the spectrum of a signal important in determining its power spectrum? 

5. Can two nonidentical signals have the same power spectrum? 

6. How much of the total energy of a rectangular video pulse does the main (first) lobe of 
the spectral diagram contain? 

7. What are the physical grounds for introducing the autocorrelation function? 

8. List the principal properties of the autocorrelation function. 

9. What should the power spectrum be for a signal whose autocorrelation function has 
a narrow main lobe? 

10. Define the constraints that can be imposed on the form of the autocorrelation function 
of a physically realizable signal. 

11. What is the basic principle underlying the construction of a multiposition (multidigit) 
discrete signal? 

12. How do we introduce the discrete autocorrelation function of a multiposition signal? 

13. Name the main property of Barker sequences. What is the advantage of these sequences 
over other possible multipulse signals? 

14. Can we realize Barker sequences with any number of positions (digits), however large? 

Problems 


1. Prove that if u(t) and v(t) are real 
signals, then the imaginary part of the 
product $,(o)Sf(o) is an odd function of 
frequency. 

2. Analyse the cross-power spectrum of 
two identical rectangular video pulses shown 
in the accompanying diagram 





depending on the time shift tọ between 
them. 

3. Derive an expression describing the 
power spectrum of the exponential video 
pulse defined by 


u(t) 2 Ugexp( — at)o(t) 
4. A Gaussian video pulse is defined by 
u(t) = Ugexp( — 6 x 107722) 


Determine the fraction of the total energy of 
the signal contained in the frequency range 
from 0 to 1.5 MHz. 

5. Find the effective bandwidth of the 
exponential signal of Problem 3, assuming it 
as a frequency band within which 90°, of 
the total signal energy is contained. 

6. Prove that the autocorrelation 
function of the exponential video pulse from 
Problem 3 is defined by 


K,(t) = (U5/a)exp( — al t |) 
7. Find the autocorrelation function of 


a signal s(t) whose spectrum is real and 
concentrated in the frequency interval [o,, 


0, |: 





8. Calculate the autocorrelation function 
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of the triangular video pulse shown below: 


Uo“ 


~ 


0 Tp 


9. Find the autocorrelation function of 
the discrete signal (1, 1, 1, —1, — 1, 1, 1}. 

Compare the result with the 
autocorrelation function of a seven-digit 
Barker sequence. 

10. Calculate the cross-correlation 
function of two Barker sequences with M — 
=5 and M=7. 


Advanced Problems 


11. Analyse experimentally the auto- 
correlation function of a six-digit discrete 
signal in which all positions are capable 


of taking on values +1 and —1 with an 
equal probability. Generate the random 
numbers by tossing a coin. 

Investigate the resulting autocorrelation 
function by comparing it with that typical of 
Barker sequences. 

Go through the experiment once more for 
a sufficiently large number of digits (15-20). 
Suggest the likely approaches to 
implementing complex signals with good 
correlation properties in the case of a large 
number of digits. 

12. Find and analyse the cross-correlation 
function of two exponential signals 


u(t) - exp( — a,1)o(t) 
v(t) 2 exp( — &5t)o (t) 


for a, x a. 


Chapter 4 
Modulated Signals 


The baseband signals coming from a message source (a 
microphone, a TV camera, a telemetry transducer, and the like) 
cannot, as a rule, be transmitted by a communication channel 
directly. This is not only because the signals are small in amplitude. 
The more important factor is that they are relatively low in fre- 
quency. For such signals to be effectively transmitted through any 
medium with the aid of electromagnetic waves, their spectrum must 
be translated from the low-frequency (baseband) region into one of 
sufficiently high frequencies. This procedure, known as modulation 
in telecommunications, will be discussed in this chapter. 


4.1 Amplitude-Modulated Signals 


Before we take up this simplest form of signal modulation in 
more detail, it is worth while to discuss briefly some matters related 
to modulation in any form. 

The carrier. The rationale of the procedure by which the 
spectrum of a signal can be translated to higher frequencies is this. 
To begin with, the transmitter generates an auxiliary r.f. wave called 
the carrier. Its mathematical model 


Ucar (t) = f (t; Gy, 05, ..., am) 


is such that we can single out a set of parameters (al, a’, ..., a) 
which specify the carrier wave. 

Let s(t) be the baseband signal to be transmitted by 
a communication channel. If at least one of the parameters (a,, a), 
.., Gm) Varies in sympathy with the baseband signal, the carrier 
acquires a new quality -it embodies the information originally 
contained in the baseband signal s(t). 

The physical process by which the parameters of the carrier are 
varied as desired is what we have called modulation. 

Communication systems widely use forms of modulation in 
which the carrier is a simple harmonic wave 


Ucar (t) = U cos (wt + ọ) (4.1) 


In this harmonic wave, we can vary any one of three independent 
parameters: the amplitude U, the angular frequency o, or the initial 
phase q so that each follows variations in the baseband signal. 
Depending on which of the three parameters is changed, we can 
derive three forms of modulation. 

The principle of amplitude modulation. When the carrier 
amplitude U(t) is made to vary in sympathy with the baseband 
signal while the other two parameters, o and «, remain unchanged, 
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we have what is called amplitude modulation. An amplitude-mo- 
dulated (AM) signal can be defined as 


uAM (t) = U (t)cos (Got + Go) (4.2) 


An AM signal has a specific waveform. Above all, it is 
symmetrical about the horizontal axis. In accord with Eq. (4.2), an 
AM signal is the product of the envelope U(t) and the harmonic 
carrier COS(@gt+@ ,). In most cases of practical interest the 
envelope varies much more slowly than the r.f. carrier. 

In amplitude modulation, the envelope U (t) and the modulating 
baseband signal s(t) are connected by a relation of the form 


U (t) 2 Ug [1 - Ms(t)] (4.3) 


Here, U, is a constant factor defining the amplitude of the carrier 
with no modulation applied, and M is called the modulation factor, 
the depth of modulation (or modulation depth) The value of 
M defines the degree of amplitude modulation. The meaning of this 
term can be understood from reference to the waveforms of AM 
signals in Fig. 4.1. 


WT Y 


(a) (5) (c) 


NI 


Ui at I | T" "T 


] M 


i 





M 





Fig. 4.1 AM signals for different depths of modulation: (a) low-level 
modulation; (b) high-level modulation; (c) overmodulation 


In the case of a small modulation depth, the relative change in 
the envelope is small 


| Ms(t)|<«1 


at all times, irrespective of the waveform of the signal s(t). On the 
other hand, when the approximate equalities 


Msmax(t) x 1 or Msgmin(t) x —1 
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are satisfied at instants when s(t) is at its extremal values, this is an 
indication of a large modulation depth. 

Sometimes, the modulation depth is expressed numerically as 
a percentage, and is then referred as the percentage modulation. This 
may be the upward percentage modulation 


Umax(t) — U 
Mae C Dn © x 100% 


or the downward percentage modulation 


U, — Umin (t 
Mdown = ara" min (t) x 100%, 
Uo 


It is not warranted to use AM signals with a small modulation 
depth in communication channels, because the power output of the 
transmitter is not fully utilized. In contrast, 100% upward 
modulation doubles the amplitude of the output wave at the peak 
values of the modulating signal. Any further increase in amplitude 
usually leads to undesirable distortion because the output stages of 
the transmitter are then overloaded. 

An excessive downward modulation is as detrimental. Refer to 
Fig. 41c which illustrates what is called overmodulation (Mdown > 
> 100%). Here the envelope ceases to follow the shape of the 
modulating signal. 

Single-tone amplitude modulation. The simplest AM signal is 
produced when the modulating baseband signal is a harmonic wave 
at a frequency Q. Then the resultant (modulated) signal 


uAM(t) = Uo [1 + M cos (Qt + ,)] cos (Wot + Po) (4.4) 


is called a single-tone AM signal. It is easy to see that single- 
tone amplitude modulation has the property of symmetry, that is, 


Mup = Mdown = M 
Let us see whether such a signal can be represented as a sum of 


simple harmonic waves. Using the trigonometric formula for the 
product of two cosines, we immediately obtain 


U,M | 
UAM (t) = Ug cos (Mot + Go) + —J— C08} (ax +Q)t+ 99 + 2. | 





U, M 
+ - cos [(o — Q) t + os — Bo | (4.5) 


Equation (4.5) defines the spectral composition of a single-tone 
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AM signal. Here 





Og = carrier frequency 
Gg +Q = upper side frequency 


O0, — Q = lower side frequency 


In plotting the spectral diagram of a single-tone AM signal 
defined in Eq. (4.5), care should be above all taken that the upper 
and lower side frequencies are equal in magnitude and are arranged 
symmetrically about the carrier frequency. 

The power characteristics of the AM signal. A matter of interest 
is the distribution of power between the carrier and the side fre- 
quencies. The source of a single-tone AM signal is equivalent to 
a sum of three harmonic sources: 


Ucar (t) = Ug cos (ost + Po) 


UM 
Uys (t) = a cos [(W) + Q) t + Po + Dy | 


IgM 





uis (t) = cos [(@) — Q)t+ Po — Po] 


For definiteness, let us deem that these are ideal voltage sources 
connected in series and loaded into a 1-ohm resistor. Then the 
instantaneous power in the AM signal will be numerically equal to 
the square of the total voltage 


p) = vam ()= We + Uis T uis + 2u artus 


+ 2uQg Us + 2ty Ms (4.6) 


car 

Characteristically, Eq. (4.6) contains both the self-power of the 
sources and their cross-powers numerically equal to the pairwise 
products of instantaneous values. 

In order to find the average power of the signal, the term p(t) 
must be averaged over a sufficiently long time interval T: 
p= li : H (t)dT 
p= um — 

T=% Ti 

It can be easily verified that averaging would cause all 
components of the cross-power to vanish, so the average power of 
an AM signal is equal to the sum of the average powers of the 
carrier and the side frequencies: 


P = Dear + Pus + Pis = UG/2 + UGSM?/8 + UZM?/8 (4.7) 


Ch. 4 Modulated Signals 
Hence, we may write 
(Pus + Pis)/Pcar = M?/2 (4.8) 


Thus, even in the case of a 100% modulation (M = 1), the total 
power in the two side frequencies is half that of the carrier. Since 
the information being transmitted is embedded in the side fre- 
quencies, we may say that amplitude modulation is rather wasteful 
of power. 

Amplitude modulation by a complex wave. In practice, 
single-tone AM signals are used but seldom. More frequently, the 
modulating baseband signal is a complex wave. It is customary to 
use the following trigonometric sum as a mathematical model for 
such a signal: 

N 
s(t) — } ajcos (Qit + i) (4.9) 
i=1 


Here the frequencies Q; form an ordered, ascending sequence Q, < 
<Q, < ... <Qn, whereas the amplitudes o; and the initial phases 
@; are arbitrary. 
Substituting (4.9) into (4.3) gives 
N 


uAM (t) - Uo [1+ } Majcos(Q;t + 0;)] cos (oot + Po) (4.10) 
i=1 


Let us introduce the set of partial modulation depths 
Mi= Ma; (4.11) 


and write an analytical expression for a multitone AM signal in 
a form which generalizes Eq. (4.4): 
N 


uAM(t) 2 Ug [1 + i Micos (Qit + 0;)] cos (ost + Po) (4.12) 


The spectral expansion is precisely the same as it is for 
a single-tone AM signal: 
N 


M : 
- cos [(@ 





U 

uaM (t) = Uo cos (Mot + Po) + X 2 
Li 
N 


U,Mi 
*Oj)t4 Po + Bi] + => 


i=1 


x cos[(og — Q) £ + Po — Di] (4.13) 


The spectral diagram of the modulating signal s(t), plotted in 
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Fig. 4.2 Spectral diagrams: (a) modulating signal; (b) AM signal in the case 
of multitone modulation 


accordance with Eq. (4.9), appears in Fig. 42a; the spectral 
diagram of the multitone AM signal corresponding to that 
baseband signal is shown in Fig. 4.2b. As is seen, in addition to the 


a carrier, the spectrum of the multitone AM signal contains a band of 
The spectrum of the upper side frequencies (the upper sideband) and a band of lower side 
AM signal frequencies (the lower sideband). The spectrum of the upper 


sideband is a scaled replica of the spectrum of the modulating 
signal, translated into the high-frequency range by «c. The lower 
sideband, too, has the spectral diagram of the signal s(t) but it is 
a mirror image of the upper sideband, both sidebands being 
symmetrically located about the carrier oy. 

From the foregoing, the following important conclusion may be 
drawn: The bandwidth occupied by an AM signal is twice the highest 
significant frequency in the spectrum of the modulating baseband 
signal. 


Example 4.1. Determine the number of radio broadcast channels 
that can be accommodated in the frequency range from 0.5 to 
1.5 MHz (this is approximately the limits of the medium-wave band ). 

For radio broadcasts to be reproduced with satisfactory fidelity, 
it is necessary to reproduce audio frequencies from 100 Hz to 12 
kHz. Hence, the bandwidth allotted to each AM channel is 24 kHz. 
To avoid cross-channel interference, a guard space of, say, | kHz, 
must be provided between adjacent channels. Therefore, the 
permissible number of channels is 


N — (1.5 — 0.5) x 109/(25 x 103) = 40 








On-off keying. An important class of multitone AM signals are 
those produced by keying. In the simplest case, they are a train of 
radio pulses separated by intervals within which there is no carrier 
present. Such signals are typical of radio telegraphy and other 
systems transmitting discrete information over radio channels. 

On-off keyed signals are widely used in pulse radar. For: better 
resolution, use is made of short pulses with a duration of a few 
fractions of a microsecond. 


e 
On-off keyed signals 
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If s(t) is a function which takes on value 0 or value 1 at each 
instant of time, then an on-off-keyed signal can be described as 


Ukeyed (t) = Ug s (t) cos (Got + Po) (4.14) 


As an example, let the function s(t) represent a periodic train of 
video pulses such as examined in Example 2.1 (see Chap. 2). 
Assume that their amplitude is A = 1, then on the basis of Eq. 
(4.14) we have 


x 


U U sin (nm/q) 
Ukeyed (£) = "n cos (Wo £ + Po) + ^ x 7 








nn/q 
n=1 
X 


U sin (nx/ 
x cos [(@) + no,) t + 95] + — y d) 
qj nn/q 


nz] 





x cos [(og — no,)t + Po] (4.15) 


From inspection of the above expression, we may conclude that 
a keyed signal has all the features of a multitone AM signal. The 
difference, at least theoretical, lies in the fact that its spectrum 
extends without bound. 

Phasor representation of an AM signal. In some cases, it may 
prove useful to represent an AM signal graphically as the sum of 
phasors rotating in a complex plane. 

For simplicity, we shall limit ourselves to the case of single-tone 
amplitude modulation. The instantaneous value of the carrier 


Ucar (t) = Ug cos (Oo t + 9o) 


is a projection of a phasor, Cas U,exp(/@o), stationary in time, 
onto the angle axis which rotates about the origin of coordinates at 
an angular velocity og in the clockwise direction (Fig. 4.3). 

The upper side wave is shown in the diagram as a phasor of 
length U,M/2, whereas its phase angle at t=0 is equal to the sum 
of the initial phases of the carrier and the modulating signal (see 
Eq. (4.5)). The lower side wave is represented by a similar phasor 
which only differs by the sign it takes in the expression for its phase 
angle. Thus, we should construct on the complex plane the sum of 
the following three phasors: 


Usa = Ugexp(jqo) 
Üus =(MU,/2)exp Li (Po + $,)] 


1s = (MU, /2)exp[j (Po — ®o)] 


It is easy to see that the sum will be oriented along the phasor 
Ucar. The instantaneous value of the AM signal at t=0 is equal to 
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(a) (b) 


Fig. 4.3 Phasor diagrams of a single-tone AM signal: (a) for t = 0; (b) for 
t>0 


the projection of the tip of the resultant phasor on the horizontal 
axis. 

As time goes on, in addition to the rotation of the angle axis we 
have already spoken about (Fig. 4.3b), two more events will occur: 
(1) the phasor Uys will rotate about the point of application at an 
angular velocity Q in the counter-clockwise direction, because the 
total phase angle of the upper side wave (o + Q)t+ Po +®, must 
increase faster than the phase of the carrier; and (2) the phasor Ui, 
will rotate likewise at an angular velocity Q, but in the opposite 
direction. : 

By constructing the phasor Uy and projecting it onto the angle 
axis, we can determine the instantaneous values uAM(t) at any 
instant of time. 

The phasor diagram of a multitone AM signal is identical in 
meaning, but the graphical construction may be unwieldy. 

Double-sideband-suppressed-carrier (DSB-SC) modulation. We 
have seen that a good proportion of the power in conventional AM 
signal is concentrated in the carrier. The transmitter power can be 
better utilized by using AM signals with a suppressed carrier. This 
is known as  double-sideband-suppressed-carrier (DSB-SC) 
modulation. On the basis of Eq. (44), a single-tone DSB-SC signal 
may be represented as follows: 


usc (t) = UgM cos (Qt + Bg) cos (Got + Po) 
= (U M/2)cos [(@p + Q) t + Po + Do] 


+ (Ua M/2)cos [(eg — Q) t + Po — Bo] (4.16) 


What happens is in effect the multiplication of two signals, the 
modulating signal and the carrier. From a physical point of view, 
oscillations such as defined by Eq. (4.16) are produced by beating 
together (heterodyning) two harmonic signals. The beats have the 
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same amplitude U,M/2 and their frequencies are respectively equal 
to the upper and lower side frequencies. 

In the case of multitone DSB-SC modulation, the analytical 
expression for the resultant signal takes the form 


N 
usc (t) = Uo 2. M;cos [(@o + Q;)t + Qo + ®;| 
N 
+ U, Y. Micos [(@) — Qj) t + Po — Bi] (4.17) 


i=1 


As with conventional amplitude modulation, there appear two 
sidebands, one upper and the other lower, located symmetrically 
about Gg. 

From an oscillogram of beats, it would appear unclear why there 
is no carrier in the spectrum of the signal, despite the generation of 
the carrier frequency component. The explanation is this. As the 
beat envelope crosses zero, the phase of the r.f. component is 
abruptly reversed, because the function (cos Qt + ®,) takes opposite 
signs on the right and left of zero. If such a signal is applied to 
a high-Q oscillatory system (say, an LC resonant circuit) tuned to 
frequency o, the output effect will be very small, tending to zero as 
the Q-factor increases without bound. The oscillations excited in the 
system by one beat cycle will be cancelled by the next. That is how 
the spectral expansion of the signal is customarily interpreted from 
a physical viewpont. We will go back to this matter in 
Chap. 9. 

For all of its obvious advantages, DSB-SC modulation has not 
found any appreciable use in radio broadcasting and radio 
communication. The principal drawback is that in demodulating 
a DSB-SC signal the carrier must be generated locally at the 
receiving end and combined with the sidebands. This substantially 
increases the complexity of the receiver. 

Single-sideband (SSB) modulation. An interesting improvement 
over the conventional amplitude modulation is the transmission of 
a signal in which the upper or lower sideband is suppressed. The 
primary advantage of SSB signals is that they require only half the 
bandwidth of DSB service. This 1s of special importance for the fre- 
quency-division multiplexing (FDM) of communication channels, 
such as in operation on short waves where the allotted frequency 
band is crowded to the limit. 

In outward appearance, SSB signals resemble conventional AM 
signals. For example, a single-tone SSB signal with the lower 
sideband suppressed may be written as 


Ussp (f) = Ug cos (oot + Po) + (UpM/2) cos [(oo + Qt + 9o + Po] 


111 





Wo 


The spectrum of an 
SSB signal 


112 


90° 





The phasor diagram of 
two signals in quadra- 
ture 


Wo 
The spectrum of an 
SSB-SC signal 


Part One. Signals 


On carrying out obvious trigonometric manipulations, we obtain 
Ussp(t) = Uo cos (Got + Po) + (UoM/2) cos (Ot + Do) cos (Wot + Po) 
— (Uo M/2)sin (Qt + By) sin (Wot + Po) 
= Uo [1 4- (M/2)cos (Qt + Bo) | cos (Wot + Po) 
— (U M/2)sin (Qt + Dy) sin (Wot + Po) 
The last terms are the products of two functions one of which 
varies more slowly. Noting that the “faster” terms are in time 


quadrature with one another, the slowly varying envelope of the 
SSB signal is found to be 





U (t)= Up V[1 + (M/2)cos (Qt + 6;)]? + (M?/4) sin? (Qt + ®,) 
= U,)/1+ M cos(Qt + ®,) + M?/4 (4.18) 


A plot of the envelope of an SSB signal, as found by Eq. (4.18) 
for M = 1, appears in Fig. 4.4 which also shows for comparison the 
envelope of a conventional single-tone AM signal for the same 
modulation depth. 





Fig. 4.4 The envelope of a single-tone signal: (1) single-tone SSB signal; (2) 
conventional AM signal for M =1 


From comparison of the two curves it is seen that the direct 
demodulation of an SSB signal from its envelope would introduce 
appreciable distortion. 

A further improvement in the SSB transmission can be achieved 
by suppressing the carrier partly or completely. In this way, the 
transmitter power is utilized still better. 


4.2 Angle Modulation 


Let us consider the case in which the modulating signal s(t) 
leaves the amplitude U, of the harmonic carrier 


Ucar (t) = Ug cos (ot + o) 
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unchanged. Instead, the entire argument of the carrier, that is the 
angle 


WO=ot+o 


called the total phase, varies in sympathy with the modulating 
signal. Quite aptly, the process is called angle modulation. 
Principles of angle modulation. Basically, the angle W(t) can be 
varied in one of two ways. In the first of these, the total phase is 
related to the modulating signal s(t) by an equation of the form 


W(t) = Wot + ks(t) (4.19) 


where k is a proportionality factor, and @, is the unmodulated 
carrier frequency (existing in the absence of the modulating signal). 
As follows from Eq. (4.19), the angle W(t) varies as the initial phase 
follows the modulating angle. In this system, the initial phase is 
proportional to the modulating signal, and the name phase 
modülation (PM) is applied: 


upy (t) = Uo cos [Wot + ks(t)] (4.20) 


So long as s(t)=0, the PM waveform is a simple harmonic wave. 
As s(t) builds up in magnitude, the angle W(z) increases with time 
faster than linearly. When the modulating signal decreases, the time 
rate of change of W(t) decreases, too. An example of a PM signal is 
shown in Fig. 4.5. 





Fig. 4.5 Phase modulation: (f) baseband modulating signal; (2) unmo- 
dulated harmonic wave; (3) phase-modulated signal 


At the instants of time when s(t) is at its peak value (positive or 
negative), the absolute value of the phase shift between the PM 
waveform and the unmodulated carrier is a maximum. This limiting 
value of the phase shift is called the phase deviation, Ay. In the 
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general case, when the signal s(t) changes sign, it is customary to 
differentiate between the upward phase deviation 


AVup = kSmax 
and the downward phase deviation 
Al down = ksmin 
If we draw a PM signal on a phasor diagram, we will see that the 
representative constant-length phasor rotates at a varying angular 


velocity. The instantaneous frequency w(t) of an angle-modulated 
signal is defined as the first time derivative of the total phase angle 


c (t) = dy/dt (4.21) 
such that 
y(t)- J Q (1) dt + const (4.22) 


In the second case, the instantaneous frequency w(t) of the 
modulated wave is made proportional to the modulating signal 
such that 


o (t) = eg + ks (t) (4.23) 
This is known as frequency modulation (FM). Here, 


upp (t) = Ugcos[aot +k f s(t)dt] (4.24) 


In the general case, the natural parameters of an FM signal are, 
in accordance with Eq. (4.23), the upward frequency modulation 


AGup — ksmax 
and the downward frequency modulation 
AGdown = kSmin 


If s(t) is a sufficiently smooth time function, there will be no 
outward difference between PM and FM waveforms. But there is 
a fundamental difference between them: the phase shift of a PM 
signal with respect to the unmodulated (reference) wave is 
proportional to s(t), whereas for an FM signal this shift is 
proportional to the integral of the signal being transmitted. 

Single-tone angle-modulated signals. Mathematically, it is far 
more complex to analyse PM and FM signals than AM signals. 
For this reason, emphasis will be placed on single-tone signals, that 
is, signals modulated by a single baseband frequency. 

For a single-tone FM signal, the instantaneous frequency is given 
by 


a (t) = eg + Ao cos (Qt + Dy) 
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where Aw is the frequency deviation. On the basis of Eq. (4.22) the 
total phase of this signal is 


V (t) = @ot + (A&o/O)sin (Ot + By) + Po 
Hence, the quantity 
m= Ao/Q (4.25) 


called the angle modulation index of a single-tone FM signal, 
represents the deviation of the signal phase, expressed in radians. 

To simplify the notation, let us set the time-invariant phase angle 
Qo and @, equal to zero and write the instantaneous value of the 
FM signal as 


u(t) = Ug cos (ost + m sin Ot) (4.26) 


The analytical expression for a single-tone PM signal will be the 
same, but the following point must be borne in mind: PM and FM 
signals behave differently as the modulating frequency and the 
amplitude of the modulating signal are varied. 

In frequency modulation, the frequency deviation Ao is 
proportional to the amplitude of the modulating (baseband) signal, 
but is independent of the modulating frequency. In phase 
modulation, the modulation index m is proportional to the 
amplitude of the modulating signal, irrespective of its frequency. As 
a consequence, the frequency deviation in FM linearly rises with 
increasing frequency Q, in accord with Eq. (4.25). 


115 


e 
The angle modulation 
index 


A 
Work Problems 6 
and 7 


"n 
Difference between 
FM and PM signals 





Example 4.2. A VHF radio station operating at a carrier frequency 


of fo =80 MHz transmits a PM signal modulated by a baseband 
signal at a frequency F — 15 kHz. The modulation index is m — 12. 
Find the limits between which the instantaneous frequency of the 
signal varies. 

The mathematical model of the signal has the form 


u(t)= Ug cos [2x x 8 x 107: + 12sin 2r x 1.5 x 10^] 
The frequency deviation is 
Af — mF = 1.8 x 10° = 180 kHz 


Thus, under modulation, the instantaneous frequency of the signal 
varies from 


fmin = 80 — 0.18 = 79.82 MHz 
to 
fmax = 80 + 0.18 = 80.18 MHz 





Spectral expansion of FM and PM signals at low values of the 
modulation index. It is relatively simple to represent angle-mo- 
dulated signals as a sum of harmonic waves, if we limit ourselves to 
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the case of m«1. For this purpose, let us re-arrange Eq. (4.26) in 
the following way: 


u(t) = Uo cos (ot + msin Qt) 


= U,cos(msin Ot)cos oot — Ug sin (msin Ot)sin Wot (4.27) 


Since we assumed a small angle modulation index, we may use 
the following approximate equalities 


cos (m sin Qt)~ 1 


sin (msin Ot) zz msin Qt 

On this basis, we obtain from Eq. (4.27) 

u (t)zz Ug cos Wot + (mU 9/2)cos (e + Q) t — (mU 9/2) cos(@_ — Q)t 
(4.28) 


Thus, at m«1, the spectrum of the angle-modulated signal 
contains the carrier wave and two side components, upper and 
lower, at frequencies cg +Q and oy — Q. The modulation index 
m plays here the same role as the modulation depth M in 
amplitude modulation (cf. Eq. (4.5). However, we can see 
a substantial difference between the spectra of an AM signal and an 
angle-modulated signal. The spectral diagram (see Fig. 4.6a) plotted 
on the basis of Eq. (4.28) is characterized by the fact that the lower 
side wave has an additional phase shift of 180". 


Uus 





180° 0? 
T T 
@9-Q wo WotQ 
(a) (5) 


Fig. 46 Diagrams of an angle-modulated signal for m«1; (a) spectral 
diagram; (b) phasor diagram 


As a consequence, the sum of the phasors representing the two 
side waves (see Fig. 4.6b) is always at right angles to the carrier 
phasor Ucar. With time, the phasor Us swings about a central 
position. The small variations in the length of the phasor are 
related to the approximate nature of our analysis; at very low 
values of m they may be justifiably neglected. 

A more rigorous spectral analysis of angle-modulated signals. We 
may try to refine the result obtained above, by using two terms 
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from the series expansion of harmonic functions of a small 
argument. Then Eq. (4.27) takes the following form 


u(t) x Ug cos ogt(1 — n? sin?Qt/2) 
— U, sin ost (msin Ot — m? sin?Qr/6) 
Simple trigonometric manipulations yield the following result: 
u(t)= U9(1 — m?/4)cosogt + Ugm(1 — m?/8) [cos (og + Q)t 


— cos (o — Q)1] + Us (m?/8) [cos (o + 20) t 
+ cos (og — 20) t] + (Ugm?/48) [cos (og + 30) t 
— cos (oy — 30) t] (4.29) 


Equation (4.29) reflects a remarkable fact: it states that in 
addition to the already known components the spectrum of 
a single-tone angle modulated signal contains the upper and lower 
side waves at the harmonic frequencies of the modulating wave. 
Therefore, the spectrum of such a signal is more complex in struc- 
ture than that of the respective AM signal. Also, the new spectral 
components lead to a redistribution of energy over the spectrum. 
Ás is seen from Eq. (4.29), an increase in m is accompanied by a rise 
in the amplitude of the side components, whereas the amplitude of 
the carrier wave decreases by a factor of (1 — m?/4). 

The spectrum of an angle-modulated signal at an arbitrary 
modulation index. For the simplest case of single-tone angle 
modulation we can derive a general expression applicable to any 
value of the modulation index m. 

The division of mathematics dealing with special functions proves 
an important formula related to the Fourier series expansion — the 
exponential function with a special form of imaginary exponent: 


exp( — jasin x) = cos (asin x) — j sin (a sin x) 
— Jo(a) - 2 Y. J kla)cos2kx 
k=1 
— j2 Y, Jay :(a)sin (2k — 1)x (4.30) 
k=1 
where Ji(a) is the Bessel function of a, of order k. From 


a comparison of (4.30) and (4.27), we may re-write the last equation 
thus: 


u(t) = Ug cos gt [Jo (m) + 2 Y, Jk(m)cos 2kOr] 
k=1 


— Up sin @ot [2 Y. Ja.  (m)sin(2k — 1) Qt] (4.31) 
k=1 
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Since 


1 1 
COS Mgt cos 2kQt = yes (og — 2kQ) t - gos (og + 2kQ)t 


and 


1 
sin Wot sin (2k — 1)Qt = > cos [oes — (2k —1)Q]t 


l 
-700s [@ + (2k — 1)Q]t 


we may re-write Eq. (4.31) in a more compact form 


aC 


u(t) - Us X p Jk (m) cos (oo + KO) t (4.32) 





To sum up, the spectrum of a single-tone angle-modulated signal 
contains, in the general case, an infinite number of components 
whose frequencies are @ọ+kQ; and their amplitudes are 
proportional to the values of J, (m). 

In the theory of Bessel functions it is proved that functions with 
positive and negative indices are interrelated: 


J -i(m) — (— 1 Jy (m) 


Therefore, the initial phases of the sidebands œ, + kQ and o, — kQ 
are the same if k is even, and differ by 180^ if k is odd. 





Fig. 4.7 Plots of Bessel functions J,(m) and J,,_(m) 
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For a detailed analysis and the construction of spectral diagrams, 
it is important to know the behaviour of functions Jj (m) according 
to the value of k for various values of m. Plots of two Bessel 
functions substantially differing in the value of k are given in 
Fig. 4.7. 

The following trend is apparent: The greater the order of a Bessel 
function, the greater the range of values of the argument for which 
the function is very small. More accurately this fact is depicted in 
Table 4-1. 


Table 4-1 Values of Bessel functions J,(r) 


In the shaded area the 
Bessel functions be- 
come negligibly small 
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Using Table 4-1 together with Eq. (4.32), we can readily construct 
typical spectral diagrams for single-tone angle-modulated signals at 
not very large values of the modulation index m (Fig. 4.8). 








(w-wo) /Q 
—4-3-2-101234 -7-6-5-4-3-2-10 1234567 

Fig. 4.8 Spectral diagrams of angle-modulated signals for two values of m. 

(The amplitudes are plotted on a relative scale.) 


120 


i 

The practical band- 
width of FM and PM 
signals 


A 
Work Problem 12 


Angle-modulated sig- 
nals are often used 
for high-fidelity broad- 
casts in the VHF 
and UHF bands 


Part One. Signals 


Interestingly, the increase in the modulation index is 
accompanied by a broadening in the bandwidth occupied by the 
signal. Ordinarily, it is assumed legitimate to neglect all spectral 
components for which k >m + 1. Hence, the practical bandwidth 
for an angle-modulated signal may be estimated as 


As a rule, for real FM and PM signals m>1. Therefore, 





BW pract 7y 2mQ = 2^0 (4.34) 





Or, in words, an angle-modulated signal occupies a bandwidth 
approximately equal to twice the frequency deviation. 

As will be recalled, the transmission of AM signals requires 
a bandwidth equal to 20, or by a factor of m smaller. The 
broadband nature of FM and PM signals limits their applicability 
to the metric and shorter wavelengths (VHF and UHF bands). On 
the other hand, this very property - the broadband nature — makes 
angle-modulated signals more immune to interference and noise as 


compared with AM signals. 
It has already been noted that the increase in the angle 


modulation index entails a re-distribution of power within the 
signal spectrum. Notably, if the value of m is chosen such that 


Jo (m) - 0 (4.35) 


the carrier frequency o will be absent in the spectrum. The values 
of m, which are the roots of Eq. (4.35), form an infinitely increasing 
sequence of numbers my (v — 1, 2, ... is the No. of the root). Several 
roots of the equation are given in Table 4-2. 


Table 4-2 Roots of the equation J(m)=0 


v 1 2 3 4 5 6 7 
my 2405 5.520 8.654 11.792 14.931 18.071 21.212 


Example 4.3. A single-tone FM signal has a frequency deviation 
Af = 240 kHz. Find the modulating frequencies F at which the carrier 
will be absent in the spectrum of the modulated signal. 

The modulation index is 


m= Ao/Q = Af/F 


Hence, the modulating frequency is 


F = Afm 


Referring to Table 4-2, we find the sequence of frequencies that 
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meet the stated condition: 
F, = 240 = 2.405 = 99.792 kHz 


F, = 240 = 5.520 = 43.478 kHz 
F, = 240 — 8.654 = 27.732 kHz 





Angle modulation in the case of a nonharmonic modulating 
wave. An interesting behaviour of angle-modulated waves is 
brought out if we analyse the case where the modulating wave is 
not harmonic. For simplicity, let us consider a signal modulated by 
two baseband frequencies: 


u(t) = Up cos (Mot + m, sinQ,t + m; sin O,t) 
= U, cos œt cos (m, sinQ,t + m; sinQ,t) 


— Upsin oet sin (m, sin Q,t + m; sin O,t) (4.36) 


Assume that the partial modulation indices m, and m, are so 
small that we may use approximate expressions for the cosine and 
the sine: 


cos x z 1 — x?/2, sinx zx 
By carrying out somewhat tedious, but elementary trigonometric 
manipulations, we may write the original signal as a sum: 


? > | 
m; + my; 


m 
u(t)= Uo (l 4 —) COS Wot + i 





U 
= 2 [cos (og 4- Q,)t 


,U 
— cos (og — 2,)t] + "a © [cos (o + Q,)t 


miUe 


— cos(og — Q5)t] + 





[cos(og + 20,)t 


?U, 
+ cos (og — 20,)t] + = [cos (@ + 22,)t + cos (@p — 205) r] 
+ aun U, [cos (@ + OQ, — Q5)t + cos(@y — Q, + Q5)t 
— cos (Oo + Q, +Q,)t — cos (© — 2, — Q5)r] (4.37) 


In sketch form, the spectral diagram of a two-tone angle-mo- 
dulated signal is shown in Fig. 4.9. 

A fact of fundamental importance should be stressed: In addition 
to the frequencies @) t O,, og X OQ, o, + 20, and @ọ t 20,, the 
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Fig. 49 Spectral diagram of a double-tone angle-modulated signal for low 
values of the partial modulation indices m; and m; 


spectrum of the above signal contains intermodulation products 
Og t Q, +Q,, taking all the four signs. Their amplitudes depend on 
the product of the two partial modulation indices. 

If we abandon the assumption of a small modulation index and 
assume that the modulation is effected by a group of baseband fre- 
quencies Q,, Q, ..., Oy, then the spectrum of a phase- or fre- 
quency-modulated signal will contain all likely frequencies o + 
+ nQ t... ŁnyQy, where n, .. ny are all likely integers, 
including zero. Thus, with all other conditions being equal, the 
spectrum of PM and FM signals is far richer in components than 
the spectrum of AM signals. 

In order to stress the interaction between the various components 
of the modulating signal, angle modulation is sometimes called 
nonlinear in contrast to amplitude modulation. 


4.3 Pulsed FM Signals 


Now let us examine the spectral and correlation properties of 
a special class of modulated signals which have recently come to be 
widely used in radar. They differ from simple r.f. pulses in that 
their carrier varies (is modulated) in frequency. Most frequently, use 
is made of a type of pulse frequency modulation in which the 
instantaneous frequency varies linearly with time. 

The principle of linear frequency modulation (LFM). Consider an 
r.f. pulse having a rectangular envelope, and assume that the r.f. 
carrier of the pulse has a frequency linearly rising with time. To 
make the mathematical model of this signal more specific, let its 
duration be tp, such that the point t = 0 occurs in the middle of the 
pulse, and the instantaneous frequency varies with time as 


o (t) = @o + ut (4.38) 


where ©ọ is the carrier frequency and p is a parameter of dimension 
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s^?, which defines the time rate of change of the frequency. 
It is easy to see that over the time interval equal to the pulse 
duration the frequency deviation will be 


AQ = Tp (4.39) 
The total phase of the signal is 
W(t) = Get + pt?/2 (4.40) 


To this we should have added the constant phase shift qo, but its 
presence is immaterial. 

Thus, let us use the term linear-FM radio pulse (or shortly, LFM 
pulse) to call a signal representable by the following mathematical 
model: 


0, t< — Tp/2 
u(t) = J U, cos (Wot + pt?/2), — tp/2 < t < Tp/2 


(4.41) 
0, t» 1y/2 

The remarkable property of LFM signals that makes them of 
practical value consists in the following. Suppose that we have at 
our disposal a physical device which delays the signals applied to 
its input. If the delay time tg is arranged to decrease with increasing 
signal frequency, then, given certain conditions, the long-duration 
LFM signals applied to the device will be "compressed" in time. 
More specifically, the output signal from the delay device, or the 
compressor, will contain both the low-frequency components 
associated with the start of the applied pulse, and the higher-fre- 
quency components associated with its finish at practically the same 
time owing to the time delay. 

It is easy to realize that if the power loss within the compressor 
is small, the amplitude of the output signal will be boosted 
appreciably and can markedly exceed the noise level. This enhances 
the reliability of radar signal detection in noise. 

The mechanism of LFM signal compression we have just 
described gives only an idea about the principle by which such 
systems operate. A more detailed analysis from which the effect can 
be judged quantitatively will be given in Chap. 16 in connection 
with the optimal detection of signals in noise. 

The spectrum of a rectangular LFM pulse. In the previous 
section concerned with the spectral characteristics of an FM signal 
modulated by two baseband frequencies, we have seen that its 
spectrum has a complex structure due to intermodulation, or the 
cross-interaction of the individual components. All this fully applies 
to the spectrum of an LFM pulse. In the discussion that follows we 
shall mainly adhere to the notation used in [21]. 

On the basis of (4.41), the amplitude spectral density, or spectrum 
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of a single LFM pulse may be written as 


Tp/+ 


U(@) =U, f cos(©ot + pt?/2)exp( — jot)dt 


=(Uo/2) {exp {f[(@p — w)t + ut?/2]) dt 


= 1/2 


1/2 
*(Uy2) | exp(—j[(oo + ot + ur*/2]) dt (442) 


= *y/2 


In analysing the above relation, we note that the first integral 
describes that part of the spectrum which has a sharp maximum in 
the region of positive frequencies close to c. Accordingly, the 
second integral corresponds to that part of the spectrum which 1s 
mainly concentrated at œ <0. In practice, we are solely interested 
in the case where the overlapping of the spectra concentrated at 
positive and negative frequencies is negligibly small. This is because 
the total frequency deviation over the pulse duration is a very small 
fraction of the carrier frequency: 


AO = [tp« O0 


Therefore, in Eq. (442) only the first integral needs to be 
evaluated as it defines the spectrum at œ > 0. Then the negative-fre- 
quency spectrum may be derived on the basis of the known 

: properties of the Fourier transform for real signals (see Chap. 2). 
As will be recalled, In view of the foregoing and completing the argument of the 
UCo) = U* (o) exponential function in (4.42) to the square, we obtain 


_ 2 1/2 
U(o) = (Uy evo| Sx Í exp] juae 
~ t,/2 


i tet. Y d (4.43) 
u 


It is convenient to change from the variable t to a new argument, 
x, in accordance with the formula 


() — (0g 





Vult- 


On calculating, we find 


2p 


== = 2 x, 
Uo)= (Uo V rnexp| -; SP | [ exp(jmx?/2)dx — (4.44) 
-X 
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where the integration limits are 


z u1,/2 + (o — à) 


X,- - 
Vni 
and 
tp/2 — (© — Mo) 
a E (445) 
p 


The integral in Eq. (444) reduces to a combination of well 
explored special functions called the Fresnel integrals: 


C (x) = fcos(n2?/2)d8 
0 


S(x) = fsin(n2?/2)d8 


0 


For x» 1, 
| |. sin(nx?/2) 
C(x)2— + — 
2 nx 
|  cos(nx?/2) 
S(x) == -————— 
2 TX 


As a result, we obtain the final formula for the spectrum of the 
LFM signal in question: 





2u 
x {C(X,)+C(X,) +j[S(X,) + S(X]] (4.46) 


U (0) = (UDV minero] =) oe | 





If we write the spectrum in exponential form 
U (o) =| U(@) | exp [j® (0)] 
it will be noted that its magnitude 
[U (9)| = (U/D V n/u V EC (X d) + CX]? + ES QC) + S(XCT? (4.47) 


whereas the phase spectrum consists of a quadratic term 


®, (@) = — (o — oy)? /2u (4.48) 
and the so-called residual phase term 

S(X4,) + S(X; 
P, (0) = arctan elas 2) (4.49) 


C(X,)+ C(X;) 
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Fresnel integrals are 
widely used in physics 
to solve problems of 
wave diffraction 
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The frequency de- 
viation-pulse duration 
product 


A 
Work Problem 14 
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LFM signals with a large frequency deviation-pulse duration 
product. Numerical analysis of the above equations indicates that 
the manner in which the magnitude and phase of the spectrum of 
a rectangular LFM pulse depend on frequency is fully decided by 
a dimensionless number 


B=Aotp = tp (4.50) 


called the frequency deviation-pulse duration product of an LFM 
signal. 

In cases of practical interest, B>1. The spectrum of such LFM 
signals has a number of specific properties. Firstly, the magnitude 
of the spectrum is practically constant over the bandwidth Aw with 
centre at og. The corresponding plots based on Eqs. (4.47) and 
(4.49) appear in Fig. 4.10. 


U| 








Aw w Aw Aw w 
Wo- —— 9? wo +> wo- —— ° wo+ Ae 


2 2 
Fig. 4.10 Frequency dependences of the magnitude and the residual phase 


term of the spectrum of a rectangular LFM signal for several values of the 
frequency deviation-pulse duration product 


Secondly, the oscillations of the magnitude gradually decay with 
increasing frequency deviation-pulse duration product. From an 
analysis of (4.47), it can be verified that at the centre frequency of 
the spectrum 





| U (@)| = Uo /n/2u (4.51) 
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Thus, an LFM signal with a large frequency deviation-pulse 
duration product can approximately be represented by the magni- 
tude of the spectrum 


(0, 0 <0 < 0o — Aw/2 
|U (9)] - $ Uo|/n/2p, @o — Aw/2 < @ < @ + Aa/2 (4.52) 
lo, o > Oo + Aw/2 


The power spectral density of such a signal 
Wa = nU$/2u (4.53) 


is likewise constant within the frequency interval (@) — A@/2, og + 
+ Aw/2), and vanishes elsewhere. 
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Example 4.4. A rectangular LFM pulse has an amplitude Uy, = 


= 20 V, a carrier frequency fy =10 GHz, and a duration tp= 2 ps. 
The frequency deviation over the pulse duration is Af = 0.1 GHz. Find 
the basic parameters of the signal spectrum. 

To begin with, we find the frequency deviation-pulse duration 


product of the signal: 
B=6.28 x 108 x 2x 1076 = 12.56 x 10? 


The rate of frequency rise is 


u = 2nAf/tp = 6.28 x 10° + (2 x 1075) = 3.14 x 101^ s 7? 


By Eq. (4.53), the power spectral density is 
Wa = 0.5 x 107 #? 


Since the signal has a large frequency deviation-pulse duration 
product, its spectrum is practically enclosed within the bandwidth 


from 
fo — Af/2 = 9.95 GHz 


to 
fo + Af/2 = 10.05 GHz 


The autocorrelation function of an LFM signal. In order to find 
this characteristic so important in signal detection, it is advisable to 
use the results obtained in Chap. 3 where it is shown that the 
autocorrelation function and the power spectrum of a signal are 
uniquely related by a Fourier transform pair. 

Let us assume that the frequency deviation-pulse duration 
product, B, of an LFM signal is so large that the power spectrum 
of the signal is uniform and concentrated around the carrier fre- 
quency within a frequency band Aw wide. Then the autocorrelation 
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function of the LFM signal [see Eq. (4.53)] may be defined as 
j. 
Kirm(t)=>— J W,(@)exp (jox) do 
LN —o 
Gor UT,/2 
(U3/2n) I cos ot do 


Oo — Hty2 


| U$1, sin (ut, 7/2 
Ig ut, 7/2 COS WoT (4.54) 
A plot of the normalized autocorrelation function 
riem (1) = Ki gu (@)/Kirm (0) 


appears in Fig. 4.11 which also shows the lobed envelope of the 
function. 








Af —VAf 0 VA 2/Af 


(b) 





Fig. 4.11 Correlation properties of an LFM-pulse: (a) normalized 
autocorrelation function; (b) its envelope 


Equation (4.54) defines an important property of LFM signals: 
The width of the main lobe in the envelope of the autocorrelation 
function is inversely proportional to the frequency deviation over 
the pulse duration. This is so because the envelope first reduces to 
zero when the time shift between the signal and its replica is equal 
to t= 2n/utp = 1/Af. Radar signals have a substantial frequency 
deviation, so the main lobe of the autocorrelation function is very 
narrow. For instance, taking the signal defined in Example 4.4, the 
time shift at which the envelope of the autocorrelation function 
reduces to zero is a mere 0.01 us, which is 0.5% of the pulse 
duration. 

From the view-point of correlation properties, however, LFM 
signals suffer from a limitation: the height of the first two 
symmetrical side lobes of the autocorrelation function is fairly large, 
being 0.212 of that of the main lobe. Given unfavourable conditions 
(a substantial noise level), this may result in an error in determining 
the time position of the pulse. 
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Modulation is a process whereby the signal spectrum is translated from the baseband 
into a radio-frequency range. 

In amplitude modulation, the signal envelope is proportional to the instantaneous 
magnitude of the baseband modulating wave. 

The spectrum of an AM signal is formed by the carrier wave and two symmetrical 
sidebands. 

The bandwidth required for AM transmission is equal to twice the highest significant 
frequency in the spectrum of the modulating wave. 

It is possible to modulate the carrier so as to produce a double-sideband (DSB) 
suppressed-carrier signal and also a single-sideband (SSB) signal. 

In angle modulation, the phase angle of the carrier varies in time in accordance with 
the message signal. 

The particular forms of angle modulation are frequency modulation and phase 
modulation. 

The principal parameter of the modulated signal in PM and FM is the angle 
modulation index equal to the phase deviation. 

Theoretically, there is no bound on the bandwidth of an angle-modulated signal. 
At small values of the modulation index, the bandwidth of the signal is practically 
equal to twice the maximum frequency of the modulating wave. 

At large values of the modulation index, the bandwidth occupied by the signal is 
equal to twice the frequency deviation. 

In linear frequency modulation, signals have a practically uniform spectrum within 
a limited bandwidth, provided the frequency deviation-pulse duration product of the 
signal is sufficiently large. 

The autocorrelation function of an LFM signal has a lobed structure; the width of the 
main lobe decreases with the increase in the frequency deviation over the pulse. 


Review Questions 


1. 


Name the parameters adopted to define the degree of amplitude modulation. 


2. Explain the cause of the distortion occurring in the case of overmodulation. 
3. 
4. How are the frequencies of the carrier wave and of the modulating wave related to each 


Define the cause of power redistribution in the spectrum of a single-tone AM signal. 


other? 


. Define the concept of the rotating phasor used to represent a single-tone AM signal. 
. What is the fundamental difference between the waveforms of a DSB signal and of 


a conventional AM signal? 


. Why is that the direct demodulation of an SSB signal results in the distortion of the 


transmitted signal? 


. Outline the similarities and differences between FM and PM signals. 
. State the relationship between the modulating frequency, modulation index, and fre- 


quency deviation. 


. What is the spectral composition of FM and PM signals at low values of the 


modulation index? 
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. Explain the difference between the spectra of an AM signal and an FM wave at low 


values of the modulation index. 


12. Which property of Bessel functions indicates that angle-modulated signals occupy 
a limited bandwidth? 

13. How should the angle modulation index be chosen for the carrier to be absent from the 
modulated signal? 

14. What is special about the spectra of FM and PM signals in the case of a nonharmonic 
modulating wave? 

15. Draw the waveform of a rectangular LFM pulse. 

16. Explain the physical principle underlying the time compression of an LFM pulse. 

17. Draw an approximate plot relating the magnitude of the spectrum of an LFM wave to 
frequency. 

18. How is the frequency deviation-pulse duration product defined for LFM signals? 

19. Define the principal characteristics of the phase spectrum of an LFM signal. 

20. What is the shape of the autocorrelation function for an LFM signal with a rectangular 
envelope? 

21. What is the limitation of LFM signals from the view-point of the structure of their 
autocorrelation function? 

Problems 


1. An AM wave is defined by 
u(t) = 130 x [1 + 0.25 cos (10?t + 30°) 


+ 0.75 cos(3 x 10?t + 45°)] x cos(10°t + 60°) 


Find the amplitudes and initial phases of all 
the spectral components and draw the 
spectral diagram of the signal. 

2. Draw a phasor diagram for the signal 
of Problem 1. Do this for time t=0. 

3. The accompanying figure shows the 
waveform of a single-tone AM signal as 
displayed by a CRT oscilloscope. Suggest an 
experimental procedure for determining the 
modulation depth M from the waveform. 


Hint. | Observe the instantaneous 
amplitudes of the signal at the extremal 
points. 


4. Using the waveform of the AM signal 
shown in the figure find the initial phases of 
each of the components of the modulating 
wave. 





5. A load resistor of 75Q carries an 
amplitude-modulated current (A) defined by 


i(t)= 200(1 + 0.8cos4 x 10?r)cos 6 x 109t 


Find: (a) the peak power delivered by the 
source; (b) the mean power dissipated in the 
load; and (c) the fraction of the total power 
concentrated in the carrier. 

6. An FM signal of 2.7 V amplitude has 
an instantaneous frequency varying as 


o(t)= 10? (1 + 107 *cos2 x 10?1) 
Find the modulation index and write 


a mathematical model of the signal. 
7. Determine the angle modulation index 
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for an FM signal, if the modulating fre- 
quency is F = 7 kHz, the carrier frequency is 
fo = 180 MHz, and the peak value of fre- 
quency is fmax = 182.5 MHz. 

8. Draw a spectral and a phasor diagram 
for an angle-modulated signal, if the carrier 
frequency is 45 MHz, the frequency 
deviation is 0.3 kHz, and the modulating 
frequency is 4.5 kHz. 

9. There is a single-tone PM signal, and 
the modulating frequency is Q = 10* s~ !. 
What should the frequency deviation be for 
the components at frequencies @ + Q to be 
absent from the signal? 

10. Draw a spectral diagram for an FM 
signal with an amplitude of 35 V and 
a modulation index of m — 3. 

11. The output signal from an FM 
transmitter in the absence of the carrier is 
250 V. Measurements show that when 
a single-tone modulating signal is applied to 
the transmitter, the output voltage rises to 
244 V. Find the frequency modulation index. 
May it be assumed that narrowband FM is 
implemented under the conditions stated? 

12. A PM radio broadcasting station is 
operating at a maximum modulation index 
of 30 (at the maximum volume of the 
transmitted signal). Assuming that the upper 
frequency limit of the modulating wave is 
16 kHz, find the number of radio channels 
that can be accommodated within the VHF 
band (30-300 MHz) without cross- 
interference. 

13. The input circuit of a radio receiver 


Y 


contains a resonant circuit tuned to a carrier 
frequency of f; = 64 MHz. The Q-factor of 
the tuned circuit is 30. Can this circuit be 
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used for the reception of an FM signal 
whose frequency varies as 


f(t) =fa (1 + 0.015c0s2.8 x 10?1) 


14. An LFM signal with a rectangular 
envelope has an amplitude of U,- 10 V, 
a duration of t5 — 15 ps, and a frequency 
deviation of 40 MHz over the pulse 
duration. Find: (1) the frequency 
deviation-pulse duration product of the 
signal; (2) the quadratic term of the phase 
spectrum at the boundary of the bandwidth 
occupied by the signal; and (3) the power 
spectrum of the signal. 


Advanced Problems 


15. Analyse how the difference in 
amplitude between the upper and lower side 
waves affects the envelope of an AM signal. 
Consider a single-tone signal with a spectral 


diagram of the form shown in the 
accompanying figure, 
Uo 
MU;/2 | 
I 
wy (2 Wo Wot 


assuming that k #1. 

16. Analyse how the failure to observe the 
constraints imposed on the upper and lower 
side frequencies affects the envelope of an 
AM signal. Assume that the two side waves 
have the same amplitude. Consider 
a single-tone signal in which the lower side 
frequency is ois = @) — Q, whereas the upper 
side frequency is @us=@) +Q+6, where 
6«Q. 

17. Apply spectral analysis to the 
envelope of a single-tone SSB signal of the 
form defined by Eq. (418) Propose 
a numerical estimate for the degree of 
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distortion in the envelope of the signal. 
18. The total phase of a two-tone FM 
signal varies as 
V (t)= 2n x 108 + 0.12sin 2r x 10*t 
+ 0.08 sin 4x. x 10*¢ 


The amplitude of the unmodulated carrier is 
Uo — 75 V. Find how the amplitude of the 


carrier will change upon the application of 
modulating signals. 

19. It is known that one of the methods 
to improve the correlation properties of 
LFM signals is to use nonlinear instead of 
linear modulation. Referring to Chap. 3 in 
[21], examine the spectrum of such complex 
signals. 


Chapter 5 
Band-Limited Signals 


As we have learned in Chap. 2, for the complete recovery of 
a signal from its spectrum it would be necessary to consider all of 
its components at frequencies from zero to infinity. This is 
unfeasible for physical reasons. Also, as œ goes to infinity, the 
contributions from the various spectral components grow negligibly 
small owing to the properties of the signals whose energy is finite. 
Finally, any real device designed to transmit and process signals 
has a finite bandwidth. This becomes especially evident in the case 
of frequency-selective filters. 

In this chapter we will deal with a special class of signals whose 
spectrum is nonzero only in a frequency interval of finite width. 
They are aptly called band-limited. 


5.1 Some Mathematical Models and Properties of 
Band-Limited Signals 


Let D be a finite frequency interval. Then the spectrum of 
a band-limited signal will be 


S(@) 40 if meD 


S(@)=0 for any other values of frequency 


The most general mathematical model for a band-limited signal 
can be derived from the Fourier inversion formula: 


s() =È [S(a)exp (or) do (5.1) 
2n D 

Depending on the choice of the frequency interval D and of the 
spectrum S(o) we can obtain a large variety of band-limited 
signals. 

The ideal low-pass signal. Consider a wave whose spectrum has 
a constant real term in a frequency interval limited to some upper 
frequency @,; outside that interval the spectrum of the signal is 
Zero 


0, O< — 0u 
S (o) J So, — Ou < Ou S Ou (5.2) 
( 0 O> 
The instantaneous values of the signal are 
(0, 


So@u sin Out (5.3) 








s(t) = (So/2n) EA exp (jot) do = ear 
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The ideal bandpass 
signal 
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Let us call this wave the ideal low-pass signal Thus we 
underscore the fact that it has the simplest spectrum among all the 
other signals of this kind. 

The plot of the ideal low-pass signal constructed on the basis of 
Eq. (5.3) yields an oscillating curve which is even about the time 
origin. Ás the upper frequency limit of the spectrum is raised, the 
central peak and the frequency of oscillation increase too. 

A more general ideal low-pass signal can be obtained by 
assuming in Eq. (5.2) that the phase of the spectrum is a linear 
function of frequency 


0, O< — Ou 
S (o) = § So exp (— jato), — Qy X 0 € Ou (5.4) 
0, Q > Qu 


Here tọ ıs a parameter defining the time shift of the wave such that 
the spectrum in (5.4) corresponds to the low-pass signal defined by 


oOv Sin Gy(t — to) 





s(t) — $ 
T @u(t — to) 

The ideal low-pass signal is an idealized representation of the 
response of a low-pass filter excited by a wave whose spectrum is 
the same over all frequencies, which is recognized as the delta- 
impulse. In this representation, it is assumed that the frequency 
response of the low-pass filter is approximated with sufficient 
accuracy by a rectangular function having the specified upper fre- 
quency limit. 

The ideal bandpass signal. Analyse the mathematical model of 
a bandpass signal whose spectrum is limited to a frequency band of 
width BW —2Ao, centred at +@,. If within that band the 
spectrum of the signal is constant: 


| So, — 0o — Ao < 0< — 0p + Ao 
S(@) = Oo — Aw < O < Og + Aw (5.5) 
0, outside the band 


then, by analogy with the previous case, we shall call this signal the 
ideal bandpass signal. 
The instantaneous values of an ideal bandpass signal can be 
found, using the inverse Fourier transform: 
vrag 25,40 sin Aot 
s(t) (Sour) Í cos tdo = —9— — ——— 
Oo — AQ x Aot 
The structure of an ideal bandpass signal is illustrated in the 
accompanying plot. As is seen, the r.f. oscillations at cg are 
accompanied by time variations in their instantaneous amplitudes. 


COS Wot (5.6) 
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The function sin (Aot)/(Aot) represents the slowly varying envelope 
of the ideal bandpass signal to within the scale factor 285Ao/n. If 
Ao/o, « 1, that is, if the relative bandwidth of the ideal bandpass 
signal is substantially less than unity, the envelope varies much 
more slowly than the r.f. carrier. 

A method, at least theoretical, to generate an ideal bandpass signal 
is obvious: We should apply a broadband excitation such as the 
delta-impulse to the input of an ideal bandpass filter which transmits 
only frequencies within the interval [o — Ao, @, + Ao]. 

Estimating some parameters of a band-limited signal. From an 
analysis of the equations derived in the previous section, it would 
be seen that the peak values of the signals involved are directly 
proportional to their bandwidth. On the other hand, as the 
bandwidth of a signal is reduced, the signal (or its envelope) varies 
with time progressively more slowly. 

It is an easy matter to develop numerical characteristics which 
would define the limiting values for the energy, amplitude and 
derivative of a band-limited signal in general form. 

Let, for example, s(t) be a signal whose spectrum is nonzero only 
within the frequency band —@y<@®<@y. Then the following 
estimate of the signal energy is obvious: 


Ou 


E m | So) S* (0) do < (u/z) Shax (5.7) 


—(, 
where Smax is the maximum magnitude of the spectrum. 
Let us find the limiting value of the signal amplitude. By the 
inverse Fourier transform 


» 


s(t) — x | S (o)exp (jot) do 


the maximum value of a signal is limited from above to a value 
equal to the sum of the magnitudes of all complex amplitudes 
corresponding to elementary intervals on the frequency axis. Since, 
on the basis of Eq. (2.17), the frequency interval of width Ao, 
forming the neighbourhood around the chosen frequency, is 
characterized by a complex amplitude 


1 
Ado = = Slo) Aw 


it follows that the instantaneous value of the signal in question 
satisfies the inequality 
Smax € (@u/t) Smax (5.8) 


The “=” sign applies only when the signal is of the ideal low-pass 
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type: Its spectrum must be constant within the bandwidth and also 
all spectral components must be able to combine coherently at 


some instant of time. 
Now it is easy to develop an estimate of the time derivative. We 
take the limit of the relation 


im 2¢+A)—s@)_, L f UN 
t $4 M iny Ar | S (œ) [exp (joA:) — 1] 


x exp(jot)do 


and note that 
exp (joAt) — 1 x joAt 


for At going to zero. By analogy with the previous case, we obtain 
the following inequality 


| ds/dt |max < (o /n) Smax (5.9) 


Orthogonal band-limited signals. The constraints imposed on the 
bandwidth of a signal permit us to find interesting and important 
classes of orthogonal signals. The simplest example is the ortho- 
gonality of two bandpass signals whose spectra exist in 
non-intersecting domains. That the scalar product of these signals is 
equal to zero stems directly from the generalized Rayleigh formula. 

The orthogonality is less obvious in the case of band-limited 
signals shifted in time relative to one another. 

Consider two ideal baseband signals u(t) and v(t). Their Sọ and 
oy are the same, but the signal v(t) lags behind the signal u(t) by 
a time tọ such that its spectrum is defined by 


Sy(@) = Su (Œœ) exp ( — jato) 
The scalar product of the two signals is 


2 : 
So Ou Sin Wy to (5.10) 





mat | expe 
= ( = 
u => j exp (joto) do m 


As follows from Eq. (5.10), two ideal baseband signals identical 
in waveform are orthogonal if the time shift between them satisfies 
the condition 
Outo = kn, k= +i, +2, SLE (5.11) 


The minimum time shift just sufficient for the signals to be ortho- 
gonal occurs at k= +1 and is equal to 


to = £(t/ou)= t 1/2fu (5.12) 
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A fact of fundamental importance is not only that two signals are 
made orthogonal. We have formed an infinite orthogonal basis 
which can serve as a coordinate system for the expansion of an 
arbitrary signal whose spectrum does not contain any frequencies 
above o. 

Plots of the signals involved appear in Fig. 5.1. 


T/Wy 2n/uwy 





J 


Fig. 5.1 Plots of two ideal baseband signals shifted in time for tọ = 1/©h 
and t, = 2n/@p 


Another important fact is this: When one of the signals reaches 
an absolute maximum, all the other signals in the set cross zero. 


5.2 The Kotelnikov Theorem 


This theorem*, proved by Kotelnikov in 1933, is one of the 
fundamental postulates of communication theory. It provides for 
the recovery of the instantaneous values of a band-limited signal to 
any desired accuracy from its samples taken at equal time intervals. 

Construction of an orthonormal basis. As has already been 
shown, any two band-limited signals belonging to the set 


sin Oy (t — kn/@u) 


, k20, +1, +2, ... 5.13 
ex (t — Efon) t pu) 


ux(t) 2 A 

are orthogonal. Through the proper choice of the amplitude 

coefficient A we can make the norm of each of these signals equal 

to unity. The result will be an orthonormal basis for the expansion 

of an arbitrary band-limited signal into a generalized Fourier series. 
We shall limit ourselves to the function 


sin Out 
Qut 





ug(t) - A 
because the norm of any signal uj is the same, irrespective of the 


* [t is usually called the sampling theorem outside the Soviet Union. 
— Translator's note. 
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nent Soviet scientist in 
the field of telecommu- 
nications and radio 
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time shift. Since 


[uo]? = (42/0) jae sail Sm Ou! ot = eA? 


then the functions uy will be orthonormal if 
A — V/ou/n 
The infinite set of functions 


— — sin Qy (t — kn/o) 


Scx(t; oy) = |/eu/n me ccm (5.14) 





form the so-called Kotelnikov basis on the linear space of low-pass 
signals limited in frequency from above by the upper limiting fre- 
quency, Gy. An individual function Scx(t;@u) is called the kth 
sample function. 

The Kotelnikov series. If s(t) is an arbitrary signal whose 
spectrum is nonzero only within the frequency band — oy « o « 
< ©, it can be expanded into a generalized Fourier series in terms 
of the Kotelnikov basis, that is, represented as 
s(t)= Y, exSek(t, eu) (5.15) 

kz -a 

The coefficients of the Kotelnikov series are the scalar products 

of the signal being expanded and the kth sample function: 


ck = [s(t), Sek(t. @u)] (5.16) 


These coefficients can conveniently be determined by using the 
generalized Rayleigh formula. It is easy to verify that within the fre- 
quency interval (— ou «co x oy) the kth sample function has 
a spectrum equal to V n/ox exp(— jokn/o,y). It is obvious from 
a comparison of Eqs. (5.3) and (5.14). Then, if S(o) is the spectrum 
of the transmitted signal s(t), we find that 


Ou 


cy = 10a E | soporo do | (5.17) 
The expression in the square brackets is nothing but the 
instantaneous value of s(t,)=s, at the kth sampling point: 


tk = kr/Ou = k/2fu 


Thus, 


Ck— V/ n/a Sk 
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Hence, the final expression for the Kotelnikov series is 


x 


s= cx 


sin oy (t — kn/@y) ks 
Sk 
k= — 0 Qu (t — kr/ou) 


(5.18) The statement of the 
Kotelnikov theorem 





On the basis of Eq. (5.18), the Kotelnikov theorem may be stated 
as follows: An arbitrary signal band-limited to frequencies not higher 
than fa Hz can be completely recovered from its samples taken at 
equal sampling intervals 1/(2fy) seconds apart. 


Example 5.1. Let there be a signal s(t)=cos out. The samples of 
f \ [ \ the signal are defined by 
1! sx = cos(Quty) = cos (kr) =(— 1)* 

| Hence, it is seen that the harmonic waveform at the highest fre- 

quency allowed by the Kotelnikov theorem is represented by two 

samples per period. If the initial phase of the signal is zero, then the 

samples are equal in magnitude, but their signs alternate. The 

Kotelnikov theorem permits us to write the following 


representation of the harmonic signal, which does not appear 
obvious at first glance: 


S (sino(t — 2kr/@)  sino[t— (2k + 1)x/o] ) 
cos@t= ) 4 — \ 
La | @(t—2kn/o) o[t—Qk--i)zr/o] | 


k=-@ 





If, on the other hand, the requirement of the Kotelnikov theorem is 
not observed and samples are taken not frequently enough, the 
recovery of the signal in accord with Eq. (5.18) is accompanied by 
an error which may be considerable. For example, the samples may 
be s, —(— 1). as in the previous case, but the signal whose 
spectrum contains frequencies higher than «y will have a more 
complex structure than a harmonic wave. 





Hardware for the synthesis of signals represented by the 
Kotelnikov series. A valuable advantage of the Kotelnikov theorem 
is its constructive character. It not only states the fact that a signal 
can be expanded into a suitable series, but also defines the method 
by which a continuous signal can be recovered from its samples A 
(Fig. $2). Solve Problem 6 
Let there be a set of generators producing sample functions 
Scr (t; @y) across their output terminals. The generators are of the 
controlled type-the amplitudes of their output signals are 
proportional to the samples sy. If, now, we combine the output 
waves by applying them to an adder, the adder output will, in 
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V 





Fig. 5.2 Set-up for the synthesis of a signal from its Kotelnikov series 


accord with Eq. (5.18), be the instantaneous value of the signal 
being synthesized, s(t). 

An approximate representation of signals by means of the 
Kotelnikov series. Cases may arise in which it is known in advance 
that the greater proportion of the energy of a signal having an 
unbounded bandwidth is concentrated in the low-frequency portion 
of the spectrum. Such signals can approximately be represented by 


the Kotelnikov series. 


Example 5.2. A rectangular video pulse of unit amplitude and of tp 
duration is not band-limited, yet the magnitude of its spectrum 
decreases with increasing frequency at a sufficiently high rate (as 1/o). 

If we represent the signal with two samples one taken at the start 


and the other at the finish of the pulse, its spectrum will include all 0 Tp 
the components up to the highest frequency @u= x/vp. Using 
Eq. (5.18), we find an approximate mathematical model for the 
signal: 
in (nt i t— 
s()- sin(nt/tp) sin (t/1p) (t — tp) (5.19) - 
RÍ/tp (n/1p) (t — Tp) 

If we represent the same signal with three equidistant samples, we 
will, as can readily be seen, include all frequencies up to @y = 2n/tp. 
Therefore, tp 


sin(2nt/tp) | sin (2n/vp) (t — 1p/2) 


s(t) Int/tp (2n/1p) (t — tp/2) 





sin nl t9) (5.20) 
(21/tp)(t — Tp) 


The corresponding plots appear in Fig. 5.3. 
Naturally, the accuracy of the approximation will improve as we 
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Fig. 5.3 Approximation of a video pulse: (1) with two members of the 
Kotelnikov series; (2) with three members of the Kotelnikov series 


take more samples, that is, as we reduce the time spacing between 
the samples. 





The error in the Kotelnikov series approximation of an arbitrary 
signal. If s(t) is an arbitrary signal, it may be represented as a sum 


s(t) = Svi (t, Ou) + se (t) 
where sbi (t, Qu) is a signal band-limited to the highest frequency @u, 
and se(t) is the approximation error signal occupying an unlimited 
frequency band o oy. 

Their spectra do not overlap, so spi and se are orthogonal, and 
their powers, that is, their norms squared, combine: 
Isl? = Il soil? + || Se ll? 

The absolute measure of the approximation error is the distance 


equal to the norm of the error signal If W;(o) is the power 
spectrum of s(t), then by the Rayleigh theorem 


1 H 71/2 
|| Sell = | (=) | W; (o) do | (5.21) 











Example 5.3. There is an exponential video pulse s(t)— 
exp( — at) (t), for which the power spectrum is 


W = 10? + o?) 


and the power is 


Is 1 da 1 
Lig" (a? +o?) 20 
0 
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The effective duration of the pulse (see Chap. 2) is 


Tp = 2.3026/a 


Suppose that the samples are taken at a rate such that in the 
time tp a total of ten samples are made available, spaced apart 


tg = 2.3026 + 9a = 0.2558/a seconds 


By the Kotelnikov theorem this means that the adopted sampling 
procedure includes all frequencies up to 


@u = T/tọ = 12.2810 
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Hence the norm of the error signal is 


W 


] 1 do 
sl =|— IX 
T a^ +o 


[ON 
Since 
Is | = 07071//a 


i - Here the theoretical 
| fn to ; ii 
r| -| 2 (5 = satan =] = 0.1608/|/a minimum of the error 


ort is meant 


it follows that the relative approximation error is Å 
|| Se || / Iis || = 0.1608 ~- 0.7071 = 0.2274 Work Problem 7 


As is seen, the adopted sampling rate is not high enough for the 


approximation to be sufficiently accurate. 





Dimensionality of the space of band- and duration-limited 
signals. As follows from the examples given in Chap. 2 to 
demonstrate the calculation of the spectrum of pulse signals, 
theoretically any signal of finite duration has a spectrum extending 
along the frequency axis without bound. In mathematics, this 
statement is proved rigorously and in the general form. 

For practical purposes, however, it is customary to consi- 
der idealized models of signals limited in duration as well as in 
bandwidth. Such models can fairly accurately represent the signals 
existing in real communication channels. 

Let T be the duration of such a signal, and fu be its upper fre- 
quency limit or, which is the same, its bandwidth in hertz. Then the 
bandwidth-duration product of the signal (see Chap. 4) will be 


BW — T fy 


For this signal to be described completely (albeit approximately for 
the reasons just stated), we must take a number N of independent 
samples, such that N = T/t, = 2Tf,. This expression defines the 
dimensionality of the space of band- and duration-limited signals. 

As a rule, the number N is fairly large. For example, in order to 
represent a radio broadcasting signal band-limited to a frequency of 
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12 kHz and duration-limited to 1 min, we shall need 
2 x 60 x 1.2 x 10* = 1.44 x 10° 


independent numbers. 

In his time, Claude Shannon proposed a convenient technique for 
interpreting duration- and band-limited signals, consisting in that 
each such signal is represented by a single point in 
a finite-dimensional Euclidean space of dimensionality 2T fy. Now 
the sample s; appears as a projection of the representative point on 
the kth coordinate axis. Because the space has an Euclidean metric 
and the coordinate axes are mutually orthogonal, the length of the 
signal vector is 

2Tf, 
rs=( Y s (522) 
k=1 
The quantity rs can be expressed in terms of the signal energy E; in 
the following way. Since 


E- Y doge i 
then it follows that 

rs V Ea V/2Tf Pm (523) 
where Pm is the mean power of the signal. Hence, any signals with 
fixed parameters T and fa, the mean power of which does not 


exceed Py, are represented by points lying within 
a multidimensional sphere of radius 


p (Po) = V2Tf. Po (5.24) 


It should be noted in conclusion that the statement of the 
Kotelnikov theorem may be somewhat extended [18]. It is true that 
for a finite-dimensional representation of the signal type in question 
we need 27f, samples. It is not mandatory, however, to require that 
the samples be equidistant in time. Also, we may halve the 
sampling rate, but at each point we should measure both the 
instantaneous value of the signal and its first derivative. 





5.3 Narrowband Signals 


This section will be concerned with a special class of 
band-limited signals which appear at the output of frequency- 
selective circuits. By definition, a signal is called narrowband if its 
spectrum is non-zero only within the frequency bands of width BW, 
in the neighbourhood of points +@,, such that BW/a, « 1. 

As a rule, the frequency Wp, called the reference frequency of the 
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signal, may be taken as being the same as the centre frequency of 
the spectrum. In the general case, however, its choice is sufficiently 


arbitrary. 

The mathematical model of a narrowband signal A straight- 
forward approach to forming a mathematical model for 
a narrowband signal is as follows. As will be recalled (see Chap. 2), 
if f, (t) is a low-pass signal whose spectrum is concentrated in the 
neighbourhood of os, then the wave 


8, (t) = fi (t) cos @ot 


will possess all the necessary properties of a narrowband signal 
because its spectrum will be concentrated near the points + e. 
The same is true of the signal 


s; (0) — f; (f) sin ag 
which only differs in the phase of the "fast" term. The most general 


expression for the mathematical model of a narrowband signal can 
be derived by analysing the following linear combination 


s(t) = As(t) cos ost — Bs (t) sin ost (5.25) 


The two time functions, As(t) and Bs(t), are of low frequency 
character in the sense that they change only slightly over a period 
of the high-frequency wave, T= 2n/@,). Customarily, the function 
As(t) is called the in-phase amplitude of a narrowband signal, s(t), 
for a specified reference frequency @), and the function B,(t) is 
called its quadrature amplitude. 

Experimentally, the instantaneous values of A,(t) and Bs(t) can 
be determined as follows. If we apply the narrowband signal s(t) to 
one input of a multiplier (mixer) and an auxiliary wave varying in 
time as cos ost, to the other input, the output will be the signal 


1 
Uout (t) = As (t) cos? Mt — 7 B, (t) sin 29t 


= As(t)/2 + [45 (0/2]cos 20st — [Bs (t)/2] sin 26st (5.26) 


Now let the output signal be applied to a low-pass fiiter, LPF, 
which suppresses frequencies of the order of 20$. Obviously, the 
output of the low-pass filter will be a low-frequency wave 
proportional to the in-phase amplitude As. The quadrature 
amplitude B,(t) of the narrowband signal s(t) can be extracted if we 
apply another auxiliary wave sin ct to the second input of the 
multiplier. 

The complex representation of narrowband signals. It is a widely 
accepted fact that many problems in the theory of linear circuits 
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can be tackled by the method of complex amplitudes. By this 
method, a harmonic wave is represented as the real or the 
imaginary part of a complex function: 


Up cos (Wot + Po) = Re [Uo exp (99) exp oot] 
Uo sin (Wot + Po) = Im [Us exp (joo) exp (@ot)] 


The time-invariant number U = U, exp (jỌo) is called the complex 
amplitude of the harmonic wave. 

From a physical point of view, narrowband signals are quasi- 
harmonic waves. Therefore, it is natural to try to generalize the 
method of complex amplitudes to signals of the type (5.25). 

Let us introduce a complex low-frequency function 





Us(t) = As(t) + jBs(t) (5.27) 





called the complex envelope of a narrowband signal. It is easy to 
verify that 


s(t) = As cos Mot — Bs sin @pt = Re [Us(t) exp (jo!) | (5.28) 


Thus, for a narrowband signal, the complex envelope is the same 
as the complex amplitude for a simple harmonic wave. However, 
the complex envelope is, in the general case, time-dependent, 
because the phasor U;(f), as it moves about in the complex plane, 
varies in both magnitude and position. 
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j U,cos@ pt, t<0 
s(t)= 
U,cosa,t, t>0 





(Us, t<0 


vie 1 Ug; exp[j(o; —oo)t], t>0 


Example 5.4. A narrowband signal s(t) is a harmonic wave at t <0 
and t>0, but at t=0 its frequency undergoes a step change: 


Taking cg as the reference frequency, we obtain the following 
expression for the complex envelope of the signal: 


It is important to stress that the choice of the reference frequency is 
fairly arbitrary and dictated by mathematical convenience. For 
example, if the reference frequency is chosen to be (og + @,)/2, the 
complex envelope of the signal in question will have the form 
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The physical envelope, the total phase, and the instantaneous fre- 
quency. Equation (5.27) defining the complex envelope may be 
re-cast in exponential form: 


Ü (t) = Us(t)exp [jos (0] (5.29) 


Here, U;(t) is a real, nonnegative function of time, called the 
physical envelope (or, simply, the envelope); @s(t) is the slowly 
varying initial phase of the narrowband signal. The two quantities 
are related to the in-phase and quadrature amplitudes: 


As(t) = Us(t)cos o; (t) (5.30) 
Bs(t) = Us(t)sin @s(t) 


Hence, we derive one more useful form for the mathematical model 
of a narrowband signal 


s(t) = Us(t) cos [ot + os (t)] (5.31) 


As we have already done in connection with angle modulation, 
we introduce the total phase of a narrowband signal 


Ws (£2) = Wot + Ps (2) 


and define the instantaneous frequency of the signal as the time 
derivative of the total phase: 


@s(t) = og + do;/dt (5.32) 


In accordance with Eq. (5.31), a narrowband signal is, in the 
general case, a complex wave produced by modulating the 
harmonic carrier both in amplitude and in phase. 

The physical envelope of a narrowband signal and its properties. 
On the basis of Eq. (5.30), let us write a formula relating the 
physical envelope U;(t) to the in-phase and quadrature amplitudes: 


Us(t) = |/ A2 + B? (5.33) 





(The arithmetic value of the root is taken.) 

As already noted, there is more than one way to define the 
complex envelope of a narrowband signal. If, instead of the fre- 
quency © appearing in Eq. (5.28), we take some other frequency, 
Gg = Oo + Ao, then the signal s(t) will be defined by 


s(t) - Re [Us (t)exp ( — jAwt) exp (jagt)] 
and its complex envelope will take the form 


Ü, (t) = U,(t) exp( — jAot) (5.34) 
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Meanwhile, however, the physical envelope, which is the magnitude 
of the complex envelope, will remain unchanged, because the term 
exp( —jAot) has a magnitude of unity. 

Another important property of the physical envelope consists in 
that at each instant of time 


|s(t)| € Us(t) 
The validity of the statement stems directly from Eq. (5.31). The 


e » 


=” sign applies at the instants when 
cos [ost + Ms(t)] = 1 
But the derivatives of the signal and of its envelope are the same: 
s' (t) = U:(t)cos [Mot + @s(t)] 


— [to + Ps (t)] Us(t)sin [Mot + os(t)] 


Therefore, the physical envelope does “enclose” the narrowband 
signal and has the meaning of its instantaneous amplitude. 

The concept of the envelope is of important significance to 
telecommunications because in practice wide use is made of special 
devices, called amplitude detectors (demodulators), which are capable 
of re-creating the envelope of a narrowband signal with high 
fidelity. 

Properties of the instantaneous frequency of a narrowband signal. 
If the complex envelope of a narrowband signal is represented by 
a phasor which rotates in the complex plane at a constant angular 
velocity Q, that is, 


Ù, (t) = Us(t) exp ( + jQt) 


then, in accord with Eq. (3.32), the instantaneous frequency of the 
signal must be constant in time: 


Ws = @) +2 


It may be argued that this signal is a harmonic wave modulated 
only in amplitude, but not in phase. Among other things, if one of 
the amplitudes, A; or B,, reduces identically to zero, then the 
instantaneous frequency at any time will be @;=@p. 

In the general case, however, the instantaneous frequency varies 
with time in the following manner: 

Bs As — As Bs 


A? + B? ve 


d 
s(t) = Oo + Gy arctan (B,/ As) = 0 + 





Relationship between the spectra of a narrowband signal and of 
its complex envelope. Let G;(@) denote the spectrum of the 
complex envelope of a narrowband signal, s(t). The spectrum of the 
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signal itself is 


S(o)= í Re[U,(t) exp (jogt)] exp ( — jo) dt 


— o 


1, 9^4 
=5 f Usexp[ —j(o — o9) t]dt 


wo 


1 s 
ta J Utexp[ —j(o - o9) r] dt 


l 1 
=z Gs(o — Go) + > GE ( —  — Wo) (5.36) 


Thus, the spectrum of a narrowband signal can be found by 
translating the spectrum of its complex envelope from the neigbour- 
hood of the zeroth frequency into the neighbourhood of points 
«0$; the amplitudes of all spectral components are halved, and 
the negative-frequency spectrum is obtained by taking the complex 
conjugate of the positive-frequency spectrum. 

Using Eq. (5.36) we can find the spectrum of the complex 
envelope of a narrowband signal from the known spectrum of the 
signal itself, and then determine the physical envelope and the 
instantaneous frequency of the signal. 








Example 5.5. Analyse a narrowband signal, s(t), whose spectrum is IS] 
asymmetrical about the frequency 9: 15s, /2 
= Í (So/2)exp [—b(o—o9] |o» 
osos L0. 0<a<a@, 


S (a) 








On the basis of Eq. (5.36), the spectrum of the complex envelope is 


-wo 0 Wo 


Gs(@) = 


J So exp(— ba), 00 
|0, o<0 


Using the inverse Fourier transform, we get IGs(w)| 
7 





Ü, (0) = (So/2n) f exp(—b + jt) o do = (Sy/2n) [1/(b — jt)] | w 


The in-phase and quadrature amplitudes of the signal respectively 


are A 
As (t) = (Sg/2r) b/(b? + t?) Solve Problem 12 


and 
Bs (t) = (So /27) tb? + t?) 
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The physical envelope is 

Us() = | Us()| = (So/2n) (1//b? + t?) 

The instantaneous frequency of the signal 
d 

9, (f) = Gg + E arctan (t/b) = e + b/(b? + t?) 


is a maximum, Gg + 1/b, at time t= 0. 
The waveform of the signal in question is a symmetric radio 
pulse whose carrier varies with time. 








5.4 The Analytic Signal 
and the Hilbert Transform 


In this section we will discuss one more method for the complex 
representation of signals, frequently used in theoretical studies. 
A distinction of the method is that the concepts of the envelope and 
of the instantaneous frequency of a signal can be introduced 
without the degree of uncertainty inherent in the method of 
complex envelopes. 

The analytic signal. Euler's formula 


cos ot = [exp (jat) + exp( — jat)]/2 


representing a harmonic wave as a sum of two complex conjugate 
functions suggests that an arbitrary signal s(t) with a known 
spectrum S (o) can be uniquely defined as a sum of two components 
each of which contains only positive or only negative frequencies: 


o0 
^ 


s()- — | S (o) exp (jot) do 


0 o0 
" 


= ES | S(@) exp (jot) do + xl S(@) exp (jot) do (5.37) 
2n 2n 


-0 


Let the function 


zs(t) = Fso exp (jot) do (5.38) 
0 


be called the analytic signal corresponding to a real signal s(t). 
By a change of variables, & = — c, the first integral on the right- 
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hand side of Eq. (5.37) can be re-arranged as 
0 


0 
"EI Cc 
5x | Stem Gos) do = + [sC- Sexo C- na 


1 i 1 
-yy [SDan 


Therefore, Eq. (5.37) relates the signals s(t) and z;(t) as 
s(t) = [zs(t) + z5(0)]/2 


or, which is the same, 


s(t) = Re[z.(1] (5.39) 


The imaginary part of the analytic signal 
$(t) = Im [z;(t)] (5.40) 


is the conjugate of the original signal s(t). 


Thus, the analytic signal 
zs(t) 2 s(t) + js(t) (5.41) 


is represented in the complex plane by a rotating phasor whose 
magnitude and phase angle vary with time. The projection of the 
analytic signal on the real axis at any time is equal to the original 
signal s (t). 

By introducing the concepts of the analytic and the conjugate 
signals, we cannot derive any new information that is not contained 
in the mathematical model of the signal s(t). However, these two 
concepts open a direct road to a systematic approach to the 
analysis of various signals, especially narrowband waves. 

Now we shall demonstrate how the analytic signal can be found 
from the known spectrum of the original signal. 


Example 5.6. Let s(t) be an ideal low-pass signal of known Sọ and S 


Qu (see Sec. 5.1). r = 
Then the analytic signal is 
Oy I w 
Zs(t) = (So/n) | exp (jot) dw = (So/jnt) [exp (jout) — 1] Wy 0 Wy 
0 


On splitting the above expression into its real and imaginary 
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Fig. 5.4 Original and conjugate signals: (1) ideal baseband signal; (2) 


conjugate signal 


parts, we obtain 


s (t) = (Sgou/n) UE 


(which is a previously known result), and 
S(t) = (Sgou/n) sin? (out/2)/(out/2) 
Plots of the signals are given in Fig. 5.4. 


The spectrum of the analytic sizue!. Let us analyse the spectrum 
of the analytic signal, that is, the function Z;(o) from which we can 
find zs(t) by using the inverse Fourier transform: 


oo 


z(= | Zs(@) exp (jot) do 


On the basis of Eq. (5.38), we may argue that this function is 
non-zero only in the region of positive frequencies: 


2 S(o), a>0 


5.42 
0, o<0 p) 


Zs(@) = 


It $ (œ) is the spectrum of the conjugate signal, then, owing to the 
linearity of the Fourier transform, we may write 


Zs(@) = S (o) ^- j$ (v) (5.43) 


Therefore, the equality in (5.42) will be fulfilled only when the 
spectra of the original and of the conjugate signals are related in 


A. 
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the following manner: 
—j$(o) | o»0 


j$(o), o<0 (344 


S(o)= ~ jsen(o)sto)= | 
where sgn(o) is the signum function. 

Abstractedly, we can imagine the following method for deriving 
the conjugate signal: The original wave s(t) is applied to the input 
of a system which rotates the phases of all the positive-frequency 
spectral components through — 90° and of all the negative-fre- 
quency components through an angle of 90° without changing their 
amplitudes. The structure possessing such properties is called the 
ideal quadratic filter. 

The Hilbert transform. Equation (5.44) shows that the spectrum 
of the conjugate signal is the product of the spectrum S (o) of the 
original signal and the function — j sgn (o). Therefore, the conjugate 
signal is the convolution of two functions, s(t) and f(t), and this 
convolution is the inverse Fourier transform of — j sgn (œ). 

For mathematical convenience, let us represent the function 
— jsgn(o) as the following limit: 


funis = Bm [= J sero) exp (lel) 
Then, 


f(t) = lim [um f exp[(e + jt) o] do 
£0 -0 


— (j/2n) { exp [(-« + iN] 40 =L 
0 nt 


By virtue of the foregoing, the conjugate signal is connected to 
the original signal by a relation of the form 


oo 


$(t) = s(t) *(1/nt) = (1/7) | S0 (5.45) 


- 00 


Alternatively, we may express the signal s(t) in terms of s(t) 
assumed to be known. To this end, it will suffice to note that the 
following relation exists between the spectra 


S (o) = j sgn (o) $ (o) 
Therefore, the respective equation will differ from (5.45) only in 
sign: 


s(t) — - ()* (nt) = — | uu dt (5.46) 
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In mathematics, Eqs. (5.45) and (5.46) are known as the Hilbert 
transform pair. Symbolically, this is written as 


$() = H [s()] - 


s()-H '[s(9] 

Since the function 1/(t— 1) called the kernel of the Hilbert 
transform, has a discontinuity at 1 — t, the integrals in (5.45) and 
(5.46) should be understood in the sense of their principal value. 
For example, 


r 
t- oo 


80 tim | dt + [Se 
E-0 E = 
+6 


-0 t 





Some properties of the Hilbert transforms. The simplest property 
of these integral transforms is their linearity: 


H [a5 (t) + azs2 (t)] = a, H [s; (0 ] + aH [s2 (0] 


at any values of the constants a, and a,, which can be verified by 
inspection. 

Since the kernel of the Hilbert transform is an odd function of 
t about the point t= t, the signal conjugate to the constant is 
identically equal to zero: 

l const 
H [const] = — | dt=0 
n t-Tt , 

Another important property of the Hilbert transform is this: If 
for any t the original signal s(t) is a maximum or a minimum, then the 
conjugate signal crosses zero in the vicinity of that point. This can be 
verified by combining in the same drawing the plots of s(t) and of 
the kernel 1/(t — t). Let t be close to that value of t at which s(t) is 
a maximum or a minimum. Then, owing to the fact that the signal 
shows even symmetry and the kernel shows odd symmetry the 
areas bounded by the horizontal axis and the curve representing the 
integrand function of the Hilbert transform cancel each other. 
Figuratively speaking, if the original signal varies in time as the 
cosine, the signal conjugate to it changes as the sine. 

It is to be noted that the Hilbert transforms are non-local: the 
behaviour of the conjugate signal in the vicinity of any point 
depends on the properties of the original signal along the entire 
time axis, although the largest contribution comes, of course, from 
the vicinity of the point in question. 

The Hilbert transform of a harmonic signal. For our subsequent 
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discussion it is important to know signals conjugate to simple 
harmonic waves of the form cos ot and sin wt. The results can be 
derived by directly using Eq. (5.45). It is simpler, however, to 
proceed as follows. Let an arbitrary signal s(t) be defined by its 
Fourier transform: 


s(t) — x | S (o)(cos ot + j sin ot) do (5.48) 


= 00 


On the basis of Eq. (5.44), the Fourier transform of the conjugate 
signal is: 


s0- 


| — j sgn (o) S (o) (cos at + j sin wt) do 


1 
~ On 


E gn (o) S (o) (sin œt — j cos ot) do (5.49) 


From a comparison of Eq. (5.49) with Eq. (5.48), the following 
relationships can be stated for the Hilbert transform: 





H [cos ot] = sin of sgn (œ) 
(5.50) 
H [sin ot] = — cos wt sgn (o) 





The Hilbert transform of a narrowband signal. Let a narrowband 
signal s(t) be represented by its in-phase and quadrature amplitudes 
at some arbitrary reference frequency: 


s(t) = As(t) cos oot — Bs (t) sin Mot (5.51) 


We will analyse the properties of the signal conjugate to s(t). To 
this end, we substitute Eq. (5.51) into Eq. (5.45), first having 
expanded the slowly varying functions A;(t) and B,(t) in a Taylor 
series about the point t— t: 


W 


S(t) = EA f E.M [As(t) + As (t) (t — x) + ...] cos MoT 
x J t-r 


=o 


oo 
1 
n t 
-x 





(t£) + Bs(t)(t — x) + ...] sin Wot 
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Since the derivatives A;, Bi, A%, B^, etc. are negligibly small, we 


limit ourselves to the first terms of the expansions. Then 
approximately 
S(t) = As(t) H [cos ost] — B (t) H [sin of] 

= A;(t)sin Wot + B; (t) cos Mot (5.52) 


Thus, in the case on hand the conjugate signal is likewise 
a narrowband wave. The last equality implies that if the complex 
envelope of the original signal is 


Us(t)= As(t) + jBs(t) 
then for the conjugate signal 
Üi) = BQ) — jA) = — jU,() 


Thus, the complex envelope of the conjugate signal differs from 
that of the original signal by a constant phase shift of 90° lagging. 

The envelope. the total phase, and the instantaneous frequency. 
Under the Hilbert transformation, the envelope U; of an arbitrary 
signal s(t) is defined as a function representing time variations in 
the analytic signal: 


Us(t) = [zs(t)|  V/s? (t) + £ (t) (5.53) 


The validity of this definition can be checked, using the envelope 
of a narrowband signal as an example. Here, on the basis of 
Eqs. (5.51) and (5.52) the envelope is defined by 


U,(t) - V A2 (t) + B2 (t) 


The above equation has been developed earlier in Sec. 5.3 from 
other considerations. 

By definition, the total phase of any signal s(t) is equal to the 
entire argument of the analytic signal z;(t): 


V; (f) = arg zs (t) = arc tan [s(t)/s(2)] (5.54) 


The instantaneous frequency @s(t) of the signal is the time 
derivative of the total phase: 


arctan E = F(9s(9 s 9st) (5.55) 





u 
SY dt Sg 


Consider several examples of how the above characteristics of 
various signals can be found. 


155 


Under the Hilbert 
transformation, the en- 
velope and the instan- 
taneous frequency are 
uniquely related to 
each other and may 
not be chosen arbitra- 
rily 
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Example 5.7. Let there be a simple harmonic wave 
s(t) = Ug cos Wot 
Then the conjugate signal will be 
§(t) = Uo sin Wot 
The envelope of the original signal 
U; — s^ (t) + 8 (t) = Uo 


does not, naturally, depend on time and is equal to its amplitude. 
The total phase of the signal is 
Ws (t) = Mot 
and, finally, its instantaneous frequency is 
Qs = Qo 
This example shows that, by defining the envelope, total phase 
and instantaneous frequency of a signal in terms of Hilbert 
transforms, we obtain results which agree with our usual notions 
about the properties of harmonic waves. 
Example 5.8. The signal s(t) is the sum of two harmonic waves 
varying in amplitude and frequency: 
s(t)= U, cos œt + U;cos o5t 
Since 
$(t) = U, sin œ; t + U,sino,t 


then the envelope of the signal varies in time as 





U,(t) - |/ U? + U3 + 2U, U, cos (@, — @,)t 
The total phase of the signal is 
Usi t + U sin @t 
Ws (t) = arcan SE E Usm or 
U,cos@,t+ U, cos @,t 


The instantaneous frequency can be found by Eq. (5.35) which 
yields the following result: 


0, U? +0, U3 + U,U, (6, + 605)cos (05 — @,)t 
U? + U} + 2U,U, cos (0; — 94)t 





@s(t) = 


The variations in the instantaneous frequency with time are due 
to the fact that in this case the phase of the resultant phasor 
representing the sum of the two harmonic waves changes at 
a varying rate, according as the phasors of the components are 
oriented relative to each other. 

Example 5.9. Consider an ideal bandpass signal band-limited to the 
frequency interval [w,, c, ]. 


42 — Q1 


- 


U, 


The rate of phase 
change is low 


()2— 


$ 


The rate of phase 
change is high 
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The corresponding analytic signal takes the form 


zs(t) - (Sym) f exp (jot) do = (So/nt) [(sin mt — sin c) 


— j (cos œt — cos 6,1)] 





The envelope of the original bandpass signal is 
U, (t) = (So/nt) / (sin ot — sin œ, t? + (cos œt — cos @, t? 


. 05;—0, 
sin —— —-t 
= So (@2 — €) | z | 
T | 9;—0, A | 
2 
Finally, the instanteneous frequency of the signal is 
df — (cos œt — cos œ; t) ] 
(s = ——1! arctan ————— —— — — | 
dt | sin@,t—sin@,t | 
After simple manipulations, we find in accordance with Eq. (5.38) 
that the instantaneous frequency 
Os = (0, + @2)/2 
is independent of time in our case and is equal to the centre fre- 
quency of the interval within which the spectrum is concentrated. 








To sum up, the concept of the analytic signal enables us to 
define the envelope and the instantaneous frequency of narrowband 
signals without resort to*the somewhat artificial concept of the 
reference frequency typical of the complex-envelope method. 
Moreover, Eqs. (5.53) through (5.55) remain in force when applied 
to arbitrary signals not necessarily quasiharmonic (narrowband). 
However, we cannot of course require that the envelope and the 
instantaneous frequency possess a simple and easy-to-grasp physical 
meaning. 

Closing remarks. The theory of the analytic signal, as applied to 
the theory of oscillations and waves, was developed by Gabor [17] 
in the 1940s. However, the Hilbert transforms had appeared in 
mathematics much earlier as a technique for solving the so-called 
boundary problem in the theory of analytic functions [10]. The 
rationale of the problem is as follows. 

Let C=& +n be a complex variable, and f(€) be a complex 
analytic function in the upper half-plane, that is, for 7 > 0. On the 
real axis which is the boundary of the analyticity region, the 
function f(£) has both a real and an imaginary part: 


f(5) — fi (5) +i 
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It is required to establish the relation that connects the functions 
Ff, Č) and f,(¢). The solution to the problem is given by a Hilbert 
transform pair: 


f; (& - H [fi E) 
AG-H AO] 


It can be shown that the analytic signal z;(t) does possess the 
property of analyticity in the upper half-plane, if it is regarded as 
a function of a complex variable, t — t' + jt". It is this property that 
explains the origin of the term "analytic". 

In recent years, the analytic-signal methods and the Hilbert 
transforms have taken up a strong position as techniques of 
communication theory. Some of the most interesting problems in 
this field are covered in [24]. 


Summary 


&$ 33 


338328 Fs 3 


Band-limited signals extend without bound in time. 

The simplest signals in this class, the ideal low-pass signal and the ideal bandpass 
signal, appear at the output of the corresponding ideal filters excited by a delta 
impulse. 

Two ideal low-pass signals can be made orthogonal through the proper choice of the 
time shift between them. 

The Kotelnikov series is a generalized Fourier series which yields the expansion of the 
signal in terms of basis functions band-limited to a certain highest frequency fa. Here, 
the basis functions are ideal low-pass signals shifted in time relative to one another by 
an interval 1/(2f,). 

The coefficients of the Kotelnikov series are the samples of the signal being expanded, 
taken at equal time intervals. 

If the signal spectrum has no components at frequencies higher than fu, the 
Kotelnikov series gives an exact (in the mean-square sense) representation of the 
signal. 

The bandwidth of a narrowband signal must be a small fraction of the centre fre- 
quency. Narrowband signals are quasiharmonic; in the general case, their amplitude 
and frequency slowly vary in time. 

The concept of the complex envelope is a generalization of the concept of the complex 
amplitude to narrowband signals. 

The physical envelope is equal to the magnitude of the complex envelope. Its form 
does not depend on the choice of the reference frequency. 

The instantaneous frequency of a narrowband signal is the sum of the reference fre- 
quency and the time derivative of the argument of the complex envelope. 
The spectrum of a narrowband signal can be derived from that of its complex 
envelope by translating it by the magnitude of the reference frequency. 

To any real signal we can assign a complex analytic signal containing solely positive- 
frequency spectral components. 
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The real part of an analytic signal is equal to the original signal. The imaginary part 
is called the conjugate signal. 

The relation between the original signal and its conjugate signal is established by 
a Hilbert transform pair. 

The envelope of an arbitrary signal is equal to the magnitude of the corresponding 
analytic signal. The instantaneous frequency is defined as a derivative of the argument 
of the analytic signal. 


iew Questions 


Why is it that band-limited signals are suitable mathematical models to represent the 
real waves observed in communication circuits? 

Draw approximate waveforms of the ideal low-pass signal and the ideal bandpass signal. 
How can it be explained that an increase in the upper frequency limit is accompanied by 
a rise in the extremal values of the ideal low-pass signal and of its derivative? 
Draw plots of several functions belonging to the Kotelnikov basis. Name their typical 
properties. 


. Write the formula of the Kotelnikov series and state in words the Kotelnikov theorem. 
. Draw a plot for the case when samples are not taken frequently enough for the 


Kotelnikov series to represent a signal faithfully. 


. What controls the magnitude of the error in the signal representation by the Kotelnikov 


series? 


. What is the graphical meaning of the dimensionality of the band- and duration-limited 


signal space? 


. Draw a typical waveform for a narrowband signal. 
. Explain how the in-phase and quadrature amplitudes of a narrowband signal can be 


determined experimentally. 


. Formulate the properties of the physical envelope of a narrowband signal. 

. Explain how the concept of the analytic signal can be introduced. 

. How are the spectra ef the original and conjugate signals related? 

. Name the basic properties of the Hilbert transform. 

. Explain how one can take the Hilbert transform of a narrowband signal. 

. Why is it that the analytic-signal method is more general than the complex-envelope 


method? 
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Problems 


1. An ideal low-pass signal has a 
spectrum whose magnitude is 5.5 x 10 * 
V s in the frequency band from zero to 
25 kHz. Find the maximum instantaneous 
value of the signal. 





2. Measurements have shown that an 
ideal bandpass signal has the following 
parameters: 9 — 20 ps and U, — 15 V. Find 
the bandwidth of the signal and the mag- 
nitude of its spectrum within the band- 
width. 

3. Evaluate the maximum value of the 
derivative of the ideal low-pass signal defi- 
ned in Problem 1. 

4. An automatic weather station transmits 
weather data at two-hour intervals. What is 
the highest frequency in the spectrum of the 
transmitted signal? 

5. The spectrum V (o) of a band-limited 
signal v(t) is triangular in shape: 


Vo 


Determine the Kotelnikov coefficients for the 
signal, assuming that samples are taken at 
time intervals equal to /o. 

6. A band-limited signal is exactly 
represented by two non-zero samples: 





What is the highest frequency in the 
spectrum of the signal? Find the in- 
stantaneous value of the signal at t= 17 ps. 

7. How will the approximation error for 
the signal in Example 5.3 increase, if the 
sampling rate is increased ten-fold? 

8. A signal s(t) is harmonic both at t>0 
and t«0; at t=0 its phase is reversed: 





Write an expression for the complex 
envelope of the signal. 
9. Derive an expression for the complex 


envelope of a truncated voltage sinewave: 





Note the initial phase of the signal. 
10. Determine the complex envelope of 
a single-tone angle-modulated signal: 


u (t) = Ug cos (oot + msin Qt) 


11. Write an expression for the complex 
envelope of an LFM signal (see Chap. 4) 
12. A narrowband signal in the 
neighbourhood of the reference frequency @o 
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has a Gaussian spectrum 
S(@) = (So/2) exp [ — b (© — ex^] 


Determine the spectrum of the complex 
envelope of the signal. Find how the 
physical envelope changes in time. Calculate 
the instantaneous frequency of the signal. 

Compare the results with those stated in 
Example 5.5. How do you explain the fun- 
damental difference between them? 

13. Find the analytic signals correspond- 
ing to simple harmonic waves sinogt and 
COS Wo. 

14. Find the analytic signal corresponding 
to an r.f. pulse which has a rectangular 
envelope 
u(t)= Uo [o (t) — o (t — tp)] cos Mot 

15. Determine the signal conjugate to 
a harmonic wave cosogt by directly using 
the Hilbert transform as given in (5.45) 

16. Solve a problem similar to that stated 
in the previous case, for a signal 
s (t) = sin Ogt/Ogt 

17. Find the signal conjugate to 
a periodic wave specified by its Fourier 
series: 


s(t)= Y, Axcos(ko,t — ox) 
k=0 


18. Show that the in-phase and quadra- 
ture amplitudes of a narrowband signal s(t) 
are connected to the components of the 
analytic signal by relations of the form: 


As(t) = s(t)cos Wot + $(t)sin Wot 


B,(t) = $(t)cos Wot — s(t)sin Wot 


Advanced Problems 


19. Prove the Kotelnikov theorem in the 
frequency representation, which is stated 
thus: If a signal s(t) is identically equal to 
zero outside the interval t, <t<t,, then its 
spectrum S(@) is uniquely defined by the 
sequence of values at points spaced 1/(t, — 
—t,) Hz apart on the frequency axis. 


20. Generalize the Kotelnikov theorem to 
the case of band-pass signals whose 
spectrum occupies a frequency band o, < 
<@<,. Find analytic expressions for the 
basis functions of these signals. 

21. Let there be a narrowband signal 


s(t) — As(t)cos ost — Bs(t)sin Mot 


Analyse the constraints that must be 
imposed on the slowly varying functions 
As(t) and B,(t) in order that the instan- 
taneous frequency be constant in time. 

22. Determine and analyse the envelope, 
the total phase, and the instantaneous fre- 
quency of the ideal low-pass signal defined 
in Example 5.6. 

23. Find the analytic signal for a wave, 
whose spectrum has a regular part and 
a component with a delta singularity. 


Ab(w — w) 





— Q3 —425—U1 0 w, Wo W3 


24. Using the analytic-signal method, 
analyse the envelope and instantaneous fre- 
quency of a single-tone SSB signal. 

25. Using the generalized Rayleigh for- 
mula, prove that if s(t) is a finite-energy 
signal, the signal conjugate under the 
Hibert transform, s(t), is orthogonal to it. 

26. Prove that the signals s(t) and s(t) 
have the same energy and the same 
autocorrelation function. 

27. Show that for a rectangular video 
pulse 


Uo, 
«o-| 0, 


the conjugate signal is 


p 1. |tp>+2¢! 
nga") P | 
tp — 2t 


— tp/2 < t< 1/2 
It| > 1/2 
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Fluctuations 


Large deviations are 
rare 
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An Outline of the Theory 
of Random Signals 


In radio communication systems, random signals most often 
occur as noise. These electromagnetic waves chaotically varying in 
time are produced in various physical structures when a charge 
carrier, say an electron, is in random motion. 

In information theory, the mathematical model of a random 
signal is used for the probabilistic representation of the relations 
existing in messages having the form of meaningful texts in some 
language. 

In present-day laser communication links, the signals are likewise 
random. The relatively high energy of a quantum of the 
electromagnetic field (a photon) makes it fundamentally necessary 
to consider the specific quantum noise which manifests itself in the 
reception of weak optical signals. 


6.1 Random Variables and Their Characteristics 


In this section we shall recapitulate the most important concepts 
from probability theory, essential in tackling the problems of 
statistical communication theory. À more detailed exposition of the 
matter can be found in [3] and [15]. 

Probabilistic laws. A distinction of a random signal is that we 
cannot predict and calculate its instantaneous values in advance. 
From an analysis of such signals, however, we may conclude that 
some of its properties can be defined with sufficient accuracy in the 
probabilistic sense. For example, the voltage across the terminals of 
a noisy circuit element consists of some average level and fast 
time-varying random variations called fluctuations. These fluc- 
tuations are such that most frequently we observe relatively small 
variations from the average level; the larger the absolute magnitude 
of the variations, the more seldom they occur. Already this is 
a statistical pattern. If we know the probabilities of fluctuations of 
various magnitude, we can develop a mathematical model for the 
random wave involved, quite acceptable in both the theoretical and 
the applied sense. 

Probabilistic laws manifest themselves whenever a physical 
system generating a random signal is an assemblage of a very large 
number of smaller subsystems executing some motions more or less 
independent of one another. For example, the current caused to 
flow around a circuit by a constant-emf source owes its constancy 
(well known from practice) to the fact that in order to produce 
a current of, say, 1.6 mA, a huge number of electrons (of the order 
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of 1015) must pass through the cross section of the conductor every 
second. Obviously the random fluctuations in velocity between the 
individual electrons can have but a negligible effect on the average 
current. 

Probability. Present-day probability theory is an axiomatized 
branch of mathematics which has pooled a wealth of material 
amassed by science in the study of widely varying random 
processes. 

The basis of this theory 1s the concept of the general population 
of "elementary outcomes" or random events 


Q- (A, A5, 5 Any} 


The symbols A; represent the likely outcomes of some random 
experiment. To each event AjeQ is assigned a real number P(Aj) 
which is called the probability of that event. 

The following axioms are accepted: 

1. The probability is non-negative and does not exceed unity: 


0< P(Aj)<1 
2. The union of all events belonging to Q is a certain event 
P(Aj)=1 
(AU PUn 


3. If A is some complex event, its probability is equal to the sum 
of all the elementary probabilities: 


P(A)= P P(A) 
¡EA 

Measurement of probabilities. The mathematical concept of the 
probability of a random event is an abstract characterization 
associated not with the material objects of interest, but with their 
set-theoretic models. Some additional agreement is in order so that 
we can extract information about the probabilities from 
experimental data. 

It is customary to evaluate the probability of an event in terms of 
the relative frequency of favourable outcomes. If we have carried 
out N independent trials and have observed an event A in n of 
them, then the empirical (or sample) estimate of the probability P(A) 
that can be derived from this series of trials is 


Ps(A) = n/N (6.1) 
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The electronic charge 
is e—1.6x10 ^ C 


The probability axi- 
oms were formulated 
by A. N. Kolmogorov 
in the 1930s 





Example 6.1. The output signal from an electronic device can take 
on only any one of two values: v, — 4.5 V (CHIGH", event A,) and 
74 —0.5 V (““LOW”, event Aj). The system can change state in 
a random manner at equal time intervals T. The experiment consists 
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in repeatedly measuring the instantaneous value of the output signal. 
The instants at which the measurements are made are arbitrary, but 
they are spaced apart substantially more than T. 

Suppose that the experimenter has carried out 100 independent 
trials during which the event A, occurred 43 times and the event 
A5, 57 times. In accordance with (6.1), the sample estimates of the 
two probabilities are 


P,(A,) = 0.43 
and 
P; (A5) = 0.57 


From these data it does not at all follow that the theoretical 
(general-population) probabilities must be like that. Rather, the 
experimenter will advance the hypothesis that the two events are 
equiprobable: 


P(A,) = P(4,) 6.5 


If, however, the same sample estimates are obtained in a series of 
10000 trials, the hypothesis must apparently be rejected. 


v,V 


-— hà C) 4 C 


Solve Problem 1 





The distribution function and the probability density. Let X be 
a random variable, that is, all possible real numbers x which take 
on random values in the interval — oo « x « + œ. The statistical 
properties of X can be described exhaustively if we have at our 
disposal a nonrandom function, F (x), of the real argument x, which 
is equal to the probability that X will take any one of the allowed 
values x or less on any given trial of the experiment: 





F (x)= P(X <x) 


The function F (x) is called the distribution function of the random 
variable X. If X can take on any value, then F(x) is a smooth, 
nondiminishing function whose values lie in the interval 0 < F (x) < 
<1. The following limiting equalities exist: F(—0c)—0 and 


F (o0) — 1. 


The derivative of the distribution function 


p(x) = dF/dx 


is the probability density of the random variable in question. 


It is obvious that 





p(x)dx = P(x < X <x+dx) 
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that is, the term p(x)dx is the probability of the random variable 
X falling within the interval (x, x + dx). 

For a continuous random variable X the probability density p(x) 
is a smooth function. If, on the other hand, X is a discrete random 
variable which can take on fixed values {x,, x;,... Xm, ..] with 
probabilities {P,, P5, .., Pm, ..] respectively, then 


p(x) = Y; Pi8(x — xj 


In either case. the probability density must satisfy the condition 
of nonnegativity 


p(x)20 


and the condition of normality 


f p(x)dx= 1 


Averaging. Moments of a random variable. Experiments fre- 
quently yield the averages of a function of the random variable. If 
(x) is a specified function of x (an outcome of a random trial), 
then, by definition, its average is 





(x)= J p(x) p(x)dx (6.2) 





From Eq. (6.2) it follows that the largest contribution to the 
average value comes from those values of x for which both the 
function being averaged, qYx), and the probability density p(x) are 
simultaneously large. 

Any statistical theory uses special numerical characteristics for 
random variables, called their moments. The nth-order moment of 
a random variable X is the nth-order average value of the random 
variable 
z= | x pogdx (6.3) 


x 


The first moment, which is the simplest moment of all, is the 
expected value (expectation or mean) of the random variable X: 


m,—-X- | xp(x)dx (6.4) 


This is an estimate for the average of a random variable, obtained 
from a sufficiently large series of trials. 
The second moment of a random variable is the mean square 
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A 
Work Problem 2 


The overscribed bar 
implies that the aver- 
age value of the quanti- 
ty under the bar is 
taken 


@ 
Moments of a random 
variable 


Expectation generali- 
zes the concept of the 
arithmetic mean in the 
probabilistic sense 
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o 
Variance 


A 
Standard deviation 


e 
Solve Problems 3 and 4 


The uniform distribu- 
tion is often used in 
error theory 
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value of that random variable: 


m,—-x?- | x?p(x)dx (6.5) 
Probability theory also uses the central moments of random 

variables, which are defined as 

linm (x —3)"— f &—X3"p69dx (6.6) 
The most important central moment is the variance of a random 

variable, defined by 


of=p, =(x— x (6.7) 
It is obvious that 
o? = (x2 — xk + X?) =x? — 5? (6.8) 
The quantity o,, that is, the square root of the variance, is called 
the standard deviation of the random variable X. It is a measure for 
the spread of the results from individual random trials about the 
sample mean. 
The uniform distribution. Let there be a random variable 
X which can take on values only from the interval x, € x < x3, 
such that they have an equal probability of falling within any inner 


subintervals of the same width Ax. Then, obviously, the probability 
density will be 


( 0, x< xX 
p(x) = 1/(x2 — x1). xı x< xX 
0, x> xX 


The distribution function is found by integration 
( 0, Xxx. 


x 
F (x)= f p&d; = 4 (x — xy (x2 — x1), X, &X € X, 
i l 1, XX, 
The expectation (or mean) 
1 B — 
Rod. ago x) 
X3— X, 5, 2 


occurs, naturally, at the centre of the interval (x,, x3). 
As can readily be verified, the variance of a random variable 
under the uniform distribution is 


oi- (x, -x,)^/12 


The Gaussian (normal) distribution. In the theory of random 
signals, a fundamental part is played by the Gaussian probability 
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density 





1 

p(x) =——— exp[ — (x — m)?/207] (6.9) 
V 2x0 

defined by two numerical parameters, m and o. The corresponding 

plot is a bell-shaped curve with a single maximum at the point x = 

— m (Fig. 6.1). 


Note that as c dec- 
reases, the plot loca- 
lizes more and more 
at x —m 





-L5 -10 -05 0 0.5 L0 1.5 


Fig. 6.1 Plot of the Gaussian probability density for several values of o 


It can be verified by direct calculation that the parameters of the 
Gaussian distribution have, respectively, the meaning of the 
expectation (mean) and the variance of a random variable: 


x=m 
ox = 07 
. 


The distribution function of a Gaussian random variable is 
x 
F(x)= (1/J/2x6) f exp[ — (É —m)*/207] dë 


By a change of variable, t — (E — m)/c, it reduces to the form 
(x -myc 


F(x)=(1///2m) f exp(- £/2)dt 


-0 


= O[(x — m)/o] (6.10) 
where the probability integral [40] is defined by 


(x) = (1/27) f exp( — t2/2) dt 


The plot of the function (Fig. 6.2) is a monotonic curve varying 


from zero to unity. . 
The probability density of a function of a random variable. Let Y 


168 


Near the origin the 


curve has a 
portion 
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dx 


linear 
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i 
-2.0-1.5 -10 -05 0 0.5 10 15 





Fig. 6.2 Plot of the distribution function for a Gaussian random variable 


be a random variable connected to X by a unique functional 
relation of the form y — f(x). The occurrence of a random point 
x within an interval of width dx and the occurrence of a random 
point y in the corresponding interval of width |dy| = |f(x)| dx are 
equiprobable events such that 

px (x)dx = |py(y)dy| 

Hence, 

Py(y) = px (x)|dx/dy| = px [g %)] |dg/dy| (6.11) 


where g(y)=x is the inverse of f(x) — y. 
If the functional relation between X and Y is not unique and 
there are several inverse functions 


xı =g) 
x2 30) 


XN = gu (Y) 
then Eq. (6.11) is generalized in the following manner: 


N 
Py(y) = p p(xi) |dxi/dy| (6.12) 





Example 6.2. Linear transformation of a Gaussian random variable. 


Let 
Y=aX +b 


and the probability density 
px(x) = (1/// 2x6) exp[ — (x — m)?/207] 


Since 
|dx/dy| = 1/lal 
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then, on the basis of Eq. (6.11), 
py() = (1//2x6la]) exp[ — (y — b — ma} /2a°0°] 


Thus, the random variable retains its Gaussian behaviour under 
linear transformation. The variable derived by this transformation 


has the mean 
y=b+ma 
and the variance 


A 
Solve Problem 7 2 22 
oy =a ox 








The characteristic function. An average of particular importance 
to probability theory is one of the form 


@(v) = exp (jux) = f p(x)exp (jvx) dx (6.13) 





called the characteristic function of the random variable X. To 
within the constant coefficient, the function O(r) is the Fourier 
transform of the probability density, so 


pou 
p(x) = = J @(v) exp( — jx) dv (6.14) 


It is clear that one and the same random variable can be equally 
well described by its characteristic function and by its probability 
density function. The choice is a matter of mathematical 
convenience. * 

Omitting elementary manipulations, here are some results: 

— for a random variable with a uniform distribution over the 
interval 0 x x <a, 


O (v) = [exp(jav) — 1]/jav (6.15) 


— for a Gaussian random variable with specified parameters 
m and o, 


O(v) = exp (jmv — o?v^/2) (6.16) 
The characteristic function offers a simple means for 


determining the moments of random variables. To demonstrate, 


d"@ (v)/dv" = j” f x" p(x) exp (jux) dx 


On setting v — 0 and equating to (6.3), we get 
m,—j "e00) (6.17) 
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Near the origin the 
curve has a linear 
portion 
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Fig. 6.2 Plot of the distribution function for a Gaussian random variable 


be a random variable connected to X by a unique functional 
relation of the form y — f(x). The occurrence of a random point 
x within an interval of width dx and the occurrence of a random 
point y in the corresponding interval of width |dy| = |f(x)| dx are 
equiprobable events such that 


Px (x) dx = |py(y)dy| 
Hence, 
Dy) = px (x) ldx/dy| = px [96] Idg/dy| (6.11) 


where g(y)= x is the inverse of f(x)= y. 
If the functional relation between X and Y is not unique and 
there are several inverse functions 


y xı =91 (9) 


X5 =g: (Y) 
dy 


XN = gN (y) 
dx then Eq. (6.11) is generalized in the following manner: 


N 
Pyly) = 2a p(xi) |dxi/dy| (6.12) 





Example 6.2. Linear transformation of a Gaussian random variable. 
Let 


Y=aX +b 

and the probability density 

Px(x) = (1/A/2x6) exp[ — (x — m)?/207] 
Since 

Idx/dy| = 1/lal 
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then, on the basis of Eq. (6.11), 
py(y) -(l //2xo|al) exp [ —-(y-b— may! /2a?o?] 


Thus, the random variable retains its Gaussian behaviour under 
linear transformation. The variable derived by this transformation 


has the mean 
y=b+ma 
and the variance 


A 
Solve Problem 7 o gigi 


The characteristic function. An average of particular importance 
to probability theory is one of the form 





©(v) = exp (jux) = f p(x)exp (jux) dx (6.13) 





called the characteristic function of the random variable X. To 
within the constant coefficient, the function O (v) is the Fourier 
transform of the probability density, so 


1 x 
p(x)= - J GO (vr) exp( — jox) dv (6.14) 


It is clear that one and the same random variable can be equally 
well described by its characteristic function and by its probability 
density function. The choice is a matter of mathematical 
convenience. * 

Omitting elementary manipulations, here are some results: 

— for a random variable with a uniform distribution over the 
interval 0 x x <a, 


O (v) = [exp (jav) — 1]/jav (6.15) 


- for a Gaussian random variable with specified parameters 
m and o, 


O (v) = exp (jmv — o?v?/2) (6.16) 


The characteristic function offers a simple means for 
determining the moments of random variables. To demonstrate, 


d"@ (v)/dv" = j” f x" p(x) exp (jux) dx 


On setting v=0 and equating to (6.3), we get 
mn —j " 9*9) (6.17) 
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Using the characteristic functions, it is convenient to find the 
probability densities of random variables that have been subjected 
to functional transformations. Thus, if 


y=f(x) 
then 
©,(v) = exp (joy) = exp [jof(x)] 


The problem on hand will be solved, if we are able to evaluate the 
Fourier transform in (6.14). 





A 
Work Problem 6 








Example 6.3. Let y= Ug cos x, where Uy is constant, whereas x is 
the value of a random variable uniformly distributed over the interval 
—nEzx«xtm. 

Since 


px(x) = 1/27 
then 


n 


G,(v) = (1/2n) f exp(»U, cos x)dx = Jo(vU,) 


-R 


where J, is the Bessel function of first kind, of order zero. Using 
the tabulated integral [40], we get 
1 © . 1 
PrO) = z J Jo(oUo)exp(vy)do = | ——— 17I < Vo 
em Te x|/U$ — y? 
0, |y| » Uo 
From the shape of the probability density plot it is seen that if 
we carry out a large series of trials, with the value of x taken each 
time at random from the specified interval, the term U, cos x will 
most often assume values close to + U,. 














6.2 Statistical Characteristics of Two and More 
Random Variables 


As is customary, the properties of a random signal process are 
analysed from the collection of values observed at different fixed 
instants, rather than at one particular time. What follows is a brief 
outline of the theory of such multivariate or vector systems. 

The distribution function and tbe probability density. Let there 
be random variables (X,, X3, ..., Xn} which form an n-dimensional 
(or vector) random variable X. By analogy with the one- 
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dimensional case, the distribution function of this vector variable 
may be defined as 


F(X, X2, -3 Xn) = P(X,& x1, X2 S X5, Xn & Xn) 


The corresponding n-dimensional (or nth-order multivariate) 
probability density p(x,, X2, .., Xn) satisfies the relation 


P(X 1. X5, -s xy) dx, dx, ...dx, 


= P{x; < X, €x; t dx,,.. Xn < Xn S xn + dxXn} 


Obviously, the distribution function can be evaluated by 
integrating the probability density function: 
a 


EAE T f Eo 


Any multivariate density has the usual properties of a univariate 
probability density 


p(51, ..., $ 20; J J pdé, dep =1 


If we know the n-dimensional density, we can always find the 
m-dimensional density for m<n by integrating over the “redun- 
dant” coordinates: 


Plis s Sm) = J m J PRs ms =s En) dEms 1 -dén 


Moments. If we know the corresponding multivariate probability 
density, we can find the Various averages of any combinations of 
the random variables involved, and, notably. their moments. For 
example, limiting ourselves to the two-dimensional case as most 
important for our further discussion, we find by analogy with (6.4) 
and (6.7) the expectations (or means) 


x= Sf X P(X, , x;)dx,dx, 


a (6.18) 
x, — Sf x2p(%1,x2)dx,dx, 
and the variances: 
of = ff (1 —X1)?p (x1, x2)dx dx, 
(6.19) 


o3= Sf (x; — xy! p(x, , x;)dx,dx; 
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The correlation mo- 
ment 
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What is new in comparison with the one-dimensional case is that 
we can form a second-order joint moment called the covariance 
moment* of a two-dimensional random variable: 


ky =X1X_ = Jf x1x2P 0%, X2)dx,dx, (6.20) 


Correlation. Suppose that we have carried out a series of trials 
each of which has yielded a two-dimensional random variable 
[x,,x;)]. Let us agree to represent the outcome of each trial by 
a point on a Cartesian plane. 

It may so happen that on the average the representative points 
fall on a straight line, which means that on any one trial the values 
x, and x, have the same sign. This suggests the existence of 
a statistical association between x, and x,, called correlation. 

On the other hand, it may so happen that the points lie in 
a chaotic fashion on the plane. Now the values are said to be 
uncorrelated, that is, there is no consistent statistical association 
between them. 

Quantitatively, the degree of statistical association between two 
random variables is stated in terms of their covariance moment k,, 
or, which is often more convenient, in terms of their correlation 
moment K,,** defined as the mean of the product (x, — x,)(x; — 
—3X3 


K,,- ff 6,— X); — x3)p (x1, x2) dx, dx; 
-k-—XQX, (6.21) 
We also introduce a dimensionless correlation coefficient 
Ry2 = Ki5/010; (6.22) 
When the two random variables are the same, that is, x4 = x), 
K,,—-K,,-o0? and R,,=R,,=1 


If a random vector variable has a dimension of more than two, 
we may form the respective cross-correlation moments 


Ky= J .. J Gi xj X) p s -s Xn) dx, .. dxa 


ey a 2» nsu 





* Other authors [16] call it correlation.- Translator's note. 
** This is frequently termed covariance. See [16, 20].- Translator's note. 
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and the respective correlation coefficients 


Rij = Kijoio; 

which can be combined into the corresponding matrices 
Eu eus cua ~~ Big i 

" Ky... + Kal and R- | Ras | Ra 
Ki oe a ow em Ru. i 


It can be shown that |R;j| < 1 always, and the equality holds only 
when x,= + xj (completely correlated variables). 

Statistical independence of random variables. By definition, the 
random variables X,, X,, .., X, are statistically independent if 
their multivariate probability density can be represented as the 
product of the corresponding univariate densities: 


ua 
P(X) X2, = Xn) = P(%1) P (x3). pa) (623) Set Huge 
dence 
Statistically independent random variables are pairwise 
uncorrelated. To demonstrate, for i z j, 
Kj= f œi- x)p(x)dxi f (xj— x) p(x) dxj =0 
— 0 — 00 A 


The converse is not true in general: If random variables are Work Problem 12 
uncorrelated, this does not mean automatically that they are 
statistically independent., 
Functional transformations of multidimensional random 
variables. Let two random vector variables X and Y be related uni- 
quely by the following relation: 


y1 7 A05. Xn) 
» s. ' » = 
for which we know the inverse functions 
X= 91 (Yis Yn) 
Xn = Onl) 
The original probability density porig(x;,...,Xn) is specified in 


advance. So that we could generalize Eq. (6.11) to a multi- 
dimensional case and evaluate the probability density of the 
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transformed vector variable, Ptrans(¥;, ... Yn), we should use the 
Jacobian of the transformation: 


C91 08, — 08i 
The Jacobian is a dy, Oy,  OYn 
coefficient of propor- 





tionality between ele- vi ee a eae a n 
mentary volumes in a On Gn Ügn 

functional transforma- Oy, ya ^ ÓOym 

tion 


Then the sought probability function takes the form 


Ptrans(V1 > Yn) = Porig(G1 s+ gn) |D] (6.25) 


Example 6.4. Let x, and x, be the random coordinates of the 
vector tip on a plane. 
If we change to the polar coordinates (p, ), 


x,—-pcosp (0<p<oo 

X,=psing 10<@<2n 

then the Jacobian of the above transformation will be 
_|cosp —psing| 
~ |sin@ pcosp| | 

So, if the specified probability density is porig(x,,x;), then 

Ptrans(P, ọ)= PPorig(p COS Q, p sin p) 


p 








The multivariate Gaussian distribution. Suppose that for an 
n-dimensional (vector) random variable, X = (X,,.., Xn}, we know 
the means (m,,...,m,), the variances (02,.., 02). and the correlation 
coefficient matrix R. 

In the general case, this information is not a sufficient basis on 
which to form the n-dimensional probability density. The only 
exception is the case where X is a multidimensional Gaussian 
variable. Then, by definition, 





I 





Paysite) Opa o, (2r) 2 D1/2 
i < Xj— Mj Xj — mj 
SE Dy——— E (6.26) 
x ew 2D D ij 9; 6j ) 





where D is the determinant of the matrix R, and Di is the cofactor 
of the element Rij in that matrix. 
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Let the vector variable X be formed by uncorrelated random 
variables such that in the matrix R only the elements on the 
principal diagonal are non-zero: Rj = ój. Then D = 1 and Dj = ój. 
On substituting them in (6.26), we have 


1 1 i (xi = mi 
yso Xp) = - ex 
P(%1 5-9 Xn) (2ny?c, ... On P 2: 2 








= p(xy)pGx)...pGa) 


where each of the univariate Gaussian distributions has the mean 
mi and the standard deviation oj. Hence we may state an important 
property of the Gaussian distribution: If a Gaussian set is formed by 
uncorrelated random variables, they are all statistically independent. 

In our further discussion we shall frequently use the bivariate 
Gaussian probability density 


l 1 [5 -m,y 
p(x,,x5)-9 —————- exXp«4 — ——_-] —— 
UU Ino ,6,)/1 — R? 20-R)| oi 


IR (x, — m,)(x2 — m) + 22 (6.27) 





0,0? 02 


where R= R,,=R,, is the correlation coefficient between x, and 
X34. The above expression is simplified if m,=m,=0 and o, = 
=O, = 67 





1 r 1 
px, X2) = ono? yi =? ap 20— R?)o? 


x (x? — 2Rx1 x3 + x2) | (6.28) 


This probability density is depicted by a smooth surface construct- 
ed over the coordinate plane (x,,x;) The value of p(x,,x,) is an 
absolute maximum at the origin. The configuration of the surface is 
decided by the correlation coefficient R. 

The multidimensional characteristic function. A generalization of 
the characteristic function to the multidimensional case is the 
n-dimensional Fourier transform of the corresponding probability 
density: 


O(0,, 025.5 Un) = exp [f(x 10, +X 202. +... + Xntn) ] 


x 


= |... f exp[j(x.0, +... + xnvn)] 


= of 


x p(X,,..-,Xn) dx, ... dx; (6.29) 


The Kronecker delta 


ash taj 
lg ie) 


a 


A 
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The multidimensional characteristic function defines a system of 
random variables to the same degree of completeness as does the 
inverse Fourier transform of the corresponding probability density: 


1 ac x 
D(x, — Xn) = On)" J - T O(v, PE Un) 
x exp[ —j(x,?, +... + Xntn)] dv, ... dv, (6.30) 


If (X,,.. Xn} are statistically independent, then, by virtue of Eq. 
(6.29), the multidimensional characteristic function factors into the 
one-dimensional characteristic functions associated with the indivi- 
dual random variables: 


n 


Q(v,,.., v.) = II Ovi) (6.31) 
i=! 


It can be shown that the characteristic function of a multi- 
dimensional Gaussian random variable X = (X ,,..., Xn} has the 
form 


n 1 n 
O(v,,.., v.) =exp( j X} mik — — Y E) (6.32) 


\ k=1 2 ki21 


where m; and of are the mean and variance of the random vector 
variable Xk, and Ry is an element of the correlation coefficient 
matrix. 

The probability density of the sum of random variables. If in 
(6.29) we set v,=v,=..=v,=v then the multidimensional 
characteristic function changes into the one-dimensional 
characteristic function of the sum x,+x,+..+Xn! 


Ox(v) = exp [jv(x, + xz +... + Xn) | 


Hence, on taking the inverse Fourier transform, we can find the 
probability density of the sum. For example, if (X,,.., Xn} are 
Gaussian, uncorrelated (and, in consequence, statistically indepen- 
dent) random variables, each of mean value mą and of standard 
deviation oy, then it follows from (6.32) that 


n 1 n 
@Qs(v) = exp (ie X m- =e x si) (6.33) 
| k=l 4 k=1 

By comparing Eq. (6.33) with Eq. (6.16), we can see that the sum 
of Gaussian random variables is likewise normally distributed, 
whereas the means and the variances are respectively added 
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together: 


m=} m, o=} of (6.34) 





In probability theory, a far stronger assertion is proved, which is 
known as Lyapunov’s Central Limit Theorem [15]. This theorem 
states that subject to certain constraints usually satisfied in physical 
systems, the distribution of the sum of n independent random 
variables whose variances are finite and whose probability distri- 
butions are arbitrary tends to the Gaussian distribution as n — oc. 


6.3 Random Processes 


The theory of random variables deals with probabilistic 
phenomena “in statics”, that is, by treating them as some fixed 
experimental results. However, the techniques of the classical 
probability theory prove inadequate when it comes to signals 
representing random phenomena varying in time. They are tackled 
by a special branch of mathematics, called the theory of random 
processes. 

By definition, a random process X (t) is a function characterized 
by the fact that at any time t the values it assumes are random 
variables. 

Ensembles of realizations. When we deal with deterministic 
signals, we represent them by functional relations or by waveforms. 
The situation is far more, complicated when it comes to random 
processes. By noting the instantaneous values of a random process 
within a certain time interval, we obtain only a single realization of 
the random process. Theoretically, a random process is expressed in 
terms of an infinite set of such realizations which form a statistical 
ensemble. An example of such an ensemble is the set of signals 
{x (0), x5(0, .-. xk(f), ..} which can simultaneously be observed at 
the outputs of absolutely :ndentical noise voltage generators. 

It is not mandatory for the realizations of a random process to 
be represented by functions with a complicated, irregular time 
behaviour. Frequently, we have to do with random processes form- 
ed by, say, all kinds of harmonic signals, U cos (ot + @), for which 
one of the parameters, U, œ or q, is a random variable assuming 
a particular value in each realization. The random character of such 
a signal is due to the fact that we cannot predict the value of that 
parameter in advance, prior to experiment. 

Random processes whose realizations depend on a finite number 
of parameters are usually termed quasideterministic. 

The probability densities of random processes. Let X(t) be 
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a random process defined by an ensemble of realizations, and 1, be 
an arbitrary point of time. By noting the values (x, (t4), xz (ti). ..., 
Xk(t,)), assumed by the individual realizations, we take 
a one-dimensional section through the random process in question 
and observe the random variable X(t,). Its probability density 
p(x, t) is called the one-dimensional or univariate probability density 
of the process X (t) at time t,. By definition, dP = p(x, t,)dx is the 
probability that the realizations of the random process will take at 
time f, the values lying in the interval (x, x + dx). 

The information that can be extracted from a one-dimensional 
(univariate) probability density is insufficient for us to judge how 
the realization of the random process changes with time. A far 
more complete description can be obtained by taking two sections 
through the random process at different instants of time, t, and t;. 
The two-dimensional random yariable {X(t,), X(t,)} emerging 
from this mental experiment can be represented by 
a two-dimensional or bivariate probability density, p(x, x4, tı, t2) 

Using this characteristic, we can determine the probability of the 
event that the realization of the random process at t= f, occurs in 
the neighbourhood of point x = x,, and at t= t;, in the neighbour- 
hood of point x = x;. 

A natural generalization is the n-dimensional  (nth-order 
multivariate) section through the random process (n > 2), resulting in 
the n-dimensional or nth-order multivariate probability density, p(x,, 
X23: dias Xm Eque bose a En): 

The multivariate probability density of a random process must 
satisfy the usual conditions imposed on the probability density of 
a set of random variables (see Sec. 6.2). Also, the quantity p(x,, X2, 
.-- Xm ti, ty, -- tn) must be independent of the order in which its 
arguments are arranged (the condition of symmetry). 

Sometimes, instead of the n-dimensional probability density, use 
is made of the n-dimensional characteristic function which is related 
to the correspondent probability density by the Fourier transform: 


OQ(v, U2, +. Um Fi l2 otn) 


x 


=f... f P(X, ..., Xn f, ..., trexp [j(v4x4 + ... 


x 


+ Unxn) | dx, ... dxa (6.35) 


Multivariate probability densities of a sufficiently high order 
make it possible to describe the properties of random processes to 
a sufficient degree of detail. However, such densities are frequently 
very difficult to obtain and analyse. 

Moment functions of random processes. Less detailed, but 
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satisfactory characteristics (in the practical sense) of random 
processes can be obtained by determining the moments of those 
random variables that are encountered in sections through the 
processes. Since in the general case these moments are functions of 
time arguments, they are called moment functions. 

In statistical communication theory, three moment functions of 
the lowest order have come to play the most important role. They 
are the expectation (or mean), the variance, and the autocorrelation 
function. 

The expectation 


m(t) ^ x(t)= f xp(x, t)dx (6.36) 


is the mean value of the process X (t) at the present instant of time 
t; averaging is done over the entire ensemble of process realizations. 
The variance 


o2()=[x—mOP= f [x(0 — mt p, dx (637) 


is a measure of the spread of the instantaneous values taken on by 
individual realizations in a fixed section about their mean. 
The second central moment 


K (ty, t3) = [x (t) ^ mt] [x (t2) — m(t)] 


=f f [x(,)—m(t,)] k(t) — m(t.)] p (x1; xa, t, t2)dx,dx, 


(6.38) 


is called the autocorrelation function* of the random process X (t). 
This function gives information about how the values of X(t) at 
one time, ¢,, are related to those at the other time, f,, in the 
statistical sense. 

From a comparison of (6.37) and (6.38), it will be noted that 
when the time sections coincide, the autocorrelation function is 
numerically equal to the variance of the random process: 


K (ty, ty) |t,=1,=1= 97 (£) (6.39) 


Stationary random processes. The term stationary refers to the 
fact that the statistical characteristics of a process remain un- 
changed with time. Random signals which are typical realizations of 
stationary random processes form an important and widely 
encountered class of random oscillations. 





* Some authors call it the  autocovariance function. See 
[20].- Translator's note. 
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A random process is said to be narrow-sense stationary if any of 
its nth-order multivariate probability densities is invariant under 
a time shift t: 

P (X1; -+ Xm 3, sims tn) = P (Xis Xm by FT, -sbn + T) (6.40) 


If we limit ourselves to the requirement that the mean m and the 
variance o? be independent of time, but let the autocorrelation 
function be only dependent on the time difference t = |t; — t, |, that 
is 


K (t,,t;) - K(x) 


then the random process will be wide-sense stationary. It is obvious 
that the property of wide-sense stationarity stems from the 
narrow-sense stationarity, but not the other way around. 

As follows from the definition of a stationary random process, 
the autocorrelation function shows even symmetry: 


K(t)= K(- 1) 


Also, the values of this function at any t do not exceed the values 
at t=0: 


K(t)< K(0)— o? (6.41) 
The proof is as follows. From the obvious inequality 
([xt) 2 m] — [x (t + 9) - m]? 20 
it follows that 
[x - m? — 2[ x(t) — m] [x(t + ) 2 m] + [x(t + 9 - mf 
= 207 — 2K (1)>0 


from which Eq. (6.41) results immediately. 
Frequently it is convenient to introduce the normalized 
autocorrelation function 





R(t) = K (1)/0? (6.42) 


also called the correlation coefficient of a stationary random 
process, for which R(0)- 1. 

To illustrate the concept of a stationary random process, let us 
consider two examples. 





Example 6.5. A random process U (t) is formed by realizations of 
the form u(t)= U,cos(@ t+), where Uy and œ are constant, 
whereas the phase angle @ is a random variable uniformly distributed 
over the interval —n x «rm. 
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Since the probability density function of the phase angle is 


Po = 1/27 


the expectation (mean) of the process will be 


n 


a= U, cos (ast + q) = (Uy /2n) | cos(mot + o)do — 0 
-n 


Similarly, the variance is 


c? = (u — u = UZ cos? ( — ost + p) = UG /2 





Finally, the autocorrelation function is 
K (t,, t) = Uo cos(@ot, + 9)cos(ost; + P) 








= (U2 2) {cos [os (t, + t5) + 29] + cos @, (t; — t,)} 


= (U2/2)cos o (t; — t) 


Solve Problem 9 Thus, the random process in question satisfies all the conditions 


necessary to assure wide-sense stationarity. 


Example 6.6. Consider a random process made up of realizations 
u(t) = Uo cos (©ot + Qo), such that oy and «y are fixed numbers, and 
U, is a random variable distributed in an arbitrary fashion. 


The expectation 
ü= U, cos (Wot + Po) 


will be independent of time only when U,=0. Therefore, in the 
general case the random process in question will be nonstationary. 








Ergodicity. A stationary random process X (t) is called ergodic, if 
its ensemble averages may be replaced with its time averages. 
Averaging is performed over a single realization x(t) whose 
duration T tends to infinity. Denoting a time average by angle 
quotes, < >, we will write the expectation (mean) of an ergodic 
random process as 

T 


m= <x(t)> = lim T x(t)dt (6.43) 
0 


which is equal to the constant term of the selected realization. 
The variance of such a process is 


T 
o? -([x(t) - m?» - ie al ()—m]^dt-x?(t» —m? (6.44) 
ò 


Since <x? > is the mean power in a realization, and m? is the 
power in the constant term, the variance has the easy-to-grasp 
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meaning of the power in the fluctuating component of the ergodic 
process. 
The autocorrelation function is found in a similar way: 


K() =< [x(t ^ m] [x(t +1) ^ m]» = < x(t)x(t - 9» — m? 


T 


l 
= lim — | x(t)x(t + t)dt — m? (6.45) 
Taw T 


0 


For a random process to be ergodic, it must above all be 
wide-sense stationary. A sufficient condition for ergodicity is that 
the autocorrelation function should tend to zero as the time 
translation 1 increases without bound: 


lim K(t)=0 (6.46) 
t- o 
It is proved in mathematics that the above requirement can be 
relaxed. As has been found, a random process is ergodic, if the 
Slutsky condition [14] is satisfied: 
T 


RA | K(t)dt=0 (6.47) 
Tao T 

0 
For example, Eq. (6.47) holds for a harmonic process with 
a random initial phase (see Example 6.5). 

Measuring the characteristics of random processes. If a random 
process is ergodic, its realization of a sufficient length is a "typical" 
representative of the entire ensemble. A sufficiently complete 
characterization of the entire process can be developed by analysing 
this only realization. 

A device to measure the univariate probability density of 
a random process can be built as follows. The univariate 
probability density of an ergodic random process should be treated 
as a quantity proportional to the relative time during which the 
realization exists at a level between x and x + Ax. Suppose that we 
have a network with two inputs one of which accepts the 
realization under analysis, x(t) and the other accepts a constant 
reference voltage whose level xy can be adjusted within certain 
limits. The output of the device delivers rectangular video pulses of 
constant amplitude, the start and finish of which are determined by 
the instants when the instantaneous value of the random signal 
corresponds to either x, or x, + Ax. If, now, we measure with an 
ordinary pointer-type instrument the average current produced by 
a train of video pulses, the meter indications will be proportional to 
the probability density p(xg) to within a constant. 

Any sufficiently sluggish pointer-type instrument can be used to 
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find the expectation (mean) of a random process [see Eq. (6.43)]. 

As follows from Eq. (6.44), the instrument used to measure the 
variance of a random process should have at its input a capacitor 
to block the passage of the d.c. component. The subsequent steps 
in the procedure, namely squaring and time-averaging, are usually 
performed by an ordinary, sufficiently sluggish square-law 
voltmeter. 

The operating principle of the instrument measuring the 
autocorrelation function (called the correlator or the correlation 
detector) arises from Eq. (6.45). Here, after the d.c. component is 
filtered out, the instantaneous level of the random signal is divided 
between two channels one of which delays its share of the signal for 
a time t. From the two channels, the divided signals are fed to 
a multiplier. The product thus formed is in turn applied to 
a sluggish element which produces an averaged output. 

The above techniques of measuring the characteristics of random 
processes are based on analog operations. Of late, there has been 
a growing trend towards using digital instruments for the purpose. 
For their operation they depend on the sampling of the random 
signal in question and the processing of the resultant sampled 
numbers in accord with Eqs. (6.43) through (6.45). 

The cross-correlation function of two random processes. In many 
cases it is of interest to know the extent to which two stationary 
random processes, X and Y, are statistically related to each other. 
For this purpose, we introduce the cross-correlation of the two 
processes 





Kxy(t,, 1) = [x()- my] [y (t5) — my] 
(6.48) 





Kyx(t, ta) = [y (t) — my] [x (t) — mx] 


Random processes are called stationary related if the 
cross-correlations Kxy(t,,£) and Kyx(t,,t,) depend only on the 
time difference t= t, — t4, and not on t, and t; themselves. Then 
the cross-correlation becomes the cross-correlation function* such 
that 


Ky (= Kyx(— 1) (6.49) 


Suppose that the random processes X (t) and Y(t) are statistically 
independent in the sense that for the instantaneous values x = x(t) 
and y;= y(t 4- 1) the bivariate probability density is 


P(x, y) = p(x) p (y:) 


* Many authors call it the cross-covariance function.- Translator's note. 
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irrespective of the value of t. Then 
o x 

Kxy(t) = f (x — mx) p(x) dx f (yr — myp(ygdyc- 0 
or, in words, from the statistical independence it follows that the 
two processes are uncorrelated. In general, the converse is not true. 

Stationary Gaussian random processes. These mathematical 
models of random signals are widely used in communication theory 
in order to describe the statistical phenomena due to a large 
number of independent random variables, that is, when the Central 
Limit Theorem applies. By definition, the nth-order multivariate 
probability density of a stationary Gaussian process depends on 
n-1 time arguments tj — ti— f, i= 2, 3, ..., n in the following way: 

l 

Dp(xi;-. Xn, Tis es 14-1) = On DIZ 


n 


1 
x e| — 2Do? > Dij(xi — m) (xj — m) | 


ij=1 
(6.50) 
Here, the notation is the same as is used in Eq. (6.26). The elements 
of the correlation matrix of this random process can be found from 
the normalized autocorrelation matrix Rij = R (ti — tj). 
Frequently, use is made of the bivariate Gaussian probability 
density 


1 
sa ST RU 
" o (x, — my — 2R(t)(x, — m)(x, — m) + (x — m)? 
exp 2e? [1 - R? (:)] 





| (6.51) 


Stationary Gaussian processes occupy an exceptional place 
among all the other random processes-any of the multivariate 
probability densities can be specified by only two characteristics: 
the expected value (mean) and the autocorrelation function. This is 
the reason why most of the results obtained in statistical 
communication theory have special reference to stationary 
Gaussian processes. 

Markov processes. In concluding this overview of the general 
methods used to describe random signals, it is worth while to dwell 
on a rather special mathematical model widely used in 
communication theory. What we mean are the so-called Markov 
random processes. 

Suppose that the state of a physical system can be characterized 
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by one of the numbers belonging to a finite set x,, x5, ..., xw. The 
change of state occurs in a random manner at fixed instants of time 
ti «t; «t4 «.... Such a random process is called the simple 
Markovian chain if the probability of observing the system in the 
state x; during the kth step solely depends on the state x; in which 
the system resided during the previous, (k — 1)st, step. The states 
associated with the steps (k— 2) (k—3) ... are immaterial. 
On designating this transition probability as py (i, j— 1, ..., N), 
we may introduce the following matrix 
"m | PP a TiN] 


PN, PN2 [PNN |] 


which completely describes the statistical properties of the 
Markovian chain. 

The basic problem that has to be solved in the theory of 
Markovian chains may be stated as follows: Given the matrix 
TI and the initial state of the process, we are to find the probability 
that the system will reach some fixed state xm in exactly n steps. 

The idea of Markov random processes can be generalized to the 
continuous-time case such that the realizations can likewise take on 
a continuous set of values. 

It is to be stressed that the Markovian properties of a random 
process are related to the dynamic behaviour of the associated 
physical system and are in no way indicative of the form of the 
probability density. Among other things, a Markov random process 
may or may not be a Gaussian process. 

There is a large body of literature on the theory and applications 
of Markov random processes (see, for example, [3] and [14]). 


Summary 


number of smaller subsystems. 


probability density. 


$$$ 


as the expected value (or mean) and the variance. 
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Statistical relations are brought out in the study of physical systems formed by a large 
The principal characteristics of a random variable are its distribution function and its 


The numerical parameters used to describe a random variable are its moments, such 


<> The statistical relations existing between the individual components of an nth-order 
(vector) random variable are defined in terms of joint second-order moments called 
correlation coefficients. 

<*> Uncorrelated Gaussian variables are statistically independent. 

<<? Under the Central Limit Theorem, in the limit m— oo the sum of m independent 


random variables is normally (Gaussian) distributed. 
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A random process is specified by an infinite ensemble of its realizations. 

The most important moment functions of a random process are its expected value 
(mean), variance, and autocorrelation function. 

A random process is called stationary if its statistical characteristics are time-invari- 
ant. 

The characteristics of stationary random processes which possess the property of 
ergodicity may be investigated experimentally by analysing only one realization. 
The expected value (mean) and the autocorrelation function make it possible to 
calculate any nth-order multivariate probability density of a stationary Gaussian 
random process. 

Realizations of Markov processes are chains of randomly changing states; the 
probability of observing any one state in a given step solely depends on the nearest 
previous state. 


Review Questions 


4A UN) — 


13. 


14. 
15. 
16. 


. State the axioms of probability theory. 

. What is the difference between the population probability and the sample probability? 
. Name the basic properties of the probability density of a random variable. 

. Formulate the principle by which the average values of the quantities functionally 


related to random variables are found. 


. What is the procedure for finding the probability density of a function of a random 


variable in the case of a unique and a non-unique relationship? 


. How is the probability density of a random variable related to its characteristic 


function? 


. What is the meaning of correlation between two random variables? 
. Which requirement is more rigorous: the uncorrelatedness or the statistical 


independence of random variables? 


. List the salient features of an nth-order Gaussian random variable. 

. State the Central Limit Theorem. 

. What is the difference between a random process and a random realization? 
. An experiment has yielded the following realization of a random signal: 


Can it belong to an ensemble of realizations of a Gaussian random process in principle? 
How valid is such a statement? 

Define (a) a wide-sense stationary random process and (b) a narrow-sense stationary 
random process. 

What is the principal property of an ergodic random process? 

What is the physical meaning of the variance of an ergodic random process? 
Define the cross-correlation function of two random processes. 
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Problems 


1. When a message is transmitted over 
a communication channel, an average of 
0.5% symbols are received in error. The 
message transmitted is 120 symbols long. 
What is the probability of faithfully 
reproducing the transmitted message? 

2. The probability density of a random 
variable X is 


p(x) - aexp(—b|x|) 


Find the relation between the numbers 
a and b, stemming from the condition of 
normality. 

3. A random variable X is uniformly 
distributed within the interval (0, 5). The 
probability of detecting this variable at the 
ends of the interval is the same and equal to 
0.3. Calculate the distribution function and 
the probability density for the random 
variable in question and construct the 
applicable plots. 

4. Find the mean and variance for the 
random variable of Problem 3. 

5. Find the mean and variance for 
a random variable whose probability density 
is 


p(x) = (a/2)exp(— |x|) ` 
for a> 0. 


6. The characteristic function O(v) of 
a random variable X has the form 


@(v) = 1/(1 + v?) 


Find the probability density p(x) of this 
random variable. 

7. Find the relation between the 
probability density p(x) of a random 
variable X and the probability density p(y) 
of another random variable Y obtained by 
the following functional transformation: 


y=exp(— x?) 


8. The joint probability density p(x,,x;) 
of a second-order random variable has the 


form 
P(X, x3) = (a? /r)exp [ — a? (x1 + x3)] 


Find the probability densities, means and 
variances of x, and x,. 

9. Prove that for a wide-sense stationarity 
of a random process X (t) with realizations 


x(t)= Acosot + Bsinot 


it is necessary and sufficient for the random 
variables A and B to have the following 
properties: 


(a) A= B=0; 
(b) o4 = 6$; 
(c) AB=0 


10. A random process Z(t) is the sum of 
two Gaussian random processes X (t) and 
Y(t) which have time-invariant means mx 
and m, and time-invariant variances o2 
and 0j, respectively. Find the univa- 
riate probability density of the total 
process. 


Advanced Problems 


11. There is a signal which is the sum of 
harmonic waves of the same frequency. The 
components have the same amplitude equal 
to 5 V. The initial phases of the components 
may take on independently only two values, 
0° and 180°. The number of components is 
30. Find the probability that the resultant 
amplitude will exceed 40 V. 

12. Prove that if a random variable Z is 
the sum of two independent random 
variables X and Y, then its probability 
density is the convolution of the individual 
(marginal) densities: 


pz(z)= Í py(Opx(z — OdG 


13. A random point Q (x, x2) is uniformly 
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distributed in a square of side a: 
a 


Q 
i 
a 
Find the mean and variance for the length 


of the random segment RQ joining the point 
to the centre of the square. 


14. The coordinates (x, y) of a random 
point in a plane are independent Gaussian 
random variables of mean value my = my — 0 
and of variance oi—02- ?. Find the 
probability density of the length of the 
random position vector of the point. 

15. Consider the feasibility of an 
instrument for measuring the bivariate 
probability density of an ergodic random 
process. 


Chapter 7 


The Correlation Theory 
of Random Processes 


In addition to a complete description of the properties of random 
signals with the aid of multivariate probability densities, a simpler 
approach may be taken in which random processes are 
characterized by their moment functions. The theory of random 
processes based on the use of at most second moment functions 
has come to be known as correlation theory. In this chapter we set 
out to demonstrate that there is a deep and close relation between 
the correlation and spectral properties of random signals. 


7.1 The Spectral Representation of Stationary 
Random Processes 


In Chap. 2, the spectral theory has been set forth for 
deterministic signals. Since individual realizations are probabilistic 
in their behaviour, the methods of spectral analysis cannot be 
carried over to the theory of random processes directly. However, 
a number of important spectral characteristics of random waves can 
be derived by taking the Fourier transforms of some functions 
formed by averaging the realizations. 

The spectrum of realizations. Consider a stationary random 
process X (t) of mean value zero, x — 0. A single realization of this 
process is a deterministic function which can be represented by the 
following spectral expansion: 


dug ae 


x 

J S(@)exp(at)do (7.1) 
X 

with a certain deterministic spectrum $ (c). 

In order to describe the entire ensemble of realizations that form 
the process X(t), we must assume that the S(coys are themselves 
random functions of frequency. Thus, a random process in the time 
domain is connected to another random process in the frequency 
domain. There is a one-to-one correspondence between the 
individual realizations of the two processes. If the realizations of 
a random process are represented as in Eq. (7.1), the process is said 
to appear in a spectral representation. 

The crucial question in the theory of random processes is: What 
properties should the random functions S(o) possess for the process 
X (t) to be stationary? 

Properties of a random spectrum. In order to answer the above 
question, we will define the mean of the instantaneous values over 


e 
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the ensemble: 
1 x 


i= - f S(@)exp(j@t)do =0 


The above equality will be satisfied identically for any t, if we 
require that 


S(@)=0 (7.2) 


In other words, the random spectrum of individual realizations of 
a stationary random process must have a mean value of zero at all 
frequencies. 

Now we should determine the conditions under which the 
autocorrelation function K(t) will depend solely on the time shift 
t between the sections. Since x(t) is a real signal, we may use, in 
addition to Eq. (7.1), also the equality 


1 oc 
x(t)=x* (j= pr J S* (o)exp( —jot)do (7.3) 


Using the spectral expansion of the random signal, we may 
write its autocorrelation function as 





K (1) 2 x(t) x(t-- x) = x* (t) x(t + 1) 


l = 
= Qn Qa ? i S(@)S* (o) exp (jot) 


x exp [j(@ — œ')t] do do’ 


== Qa - f exp(jot)do f KONAC 


x exp[j(o — a’) t] da’ (7.4) 


Here the inner integrand contains the factor S(o)S* (o') which has 
the meaning of the autocorrelation function of a random spectrum. 
For K (1) not to be dependent on t, it is necessary, as is seen from 
Eq. (7.4), to require that the following proportionality be satisfied: 


S (Q) $* (o) ~ 6 (o — e) (7.5) 


Thus, the random spectrum $ (c) of a stationary random process 
has a very specific structure: The spectra corresponding to any two 
non-coincident frequencies are mutually uncorrelated, whereas the 
mean square (variance) of the random spectrum is large without 
bound. This form of statistical association is called delta correlation. 

The power spectrum of a stationary random process. Let us 
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introduce a frequency-dependent proportionality factor in Eq. (7.5) 
and re-write the equation as follows: 


S (0) S* (w) = 21W(o)8 (o — o) (7.6) 


The function W(o), playing a fundamental role in the theory of 
stationary random processes, is called the power spectrum* of the 
process X (t). 

On substituting (7.6) into (7.4), we obtain an important result: 





f W(o)exp(j ot) da (7.7) 


EU Rp cad 





Thus the autocorrelation function and the power spectrum of 
a stationary random process of mean value zero are each other's 
Fourier transforms. This relation is also called the Wiener-Khinchin 
(W-K) theorem. 

Hence, 





W(o)- f K(t)exp(—jot)dt (7.8) 





To clarify the physical significance of the power spectrum, let us 

set t=O in Eq. (7.7). Then, since K(0)= o?, we get 
1” 

Pese W(o)d 79 
[e] A 4, (o) do . (7.9) 
The variance 6?, equal to the mean power in the stationary random 
process, is thus the sum of the contributions from all frequencies. 
The quantity W(o) is a measure of the mean power in the process 
per unit of bandwidth in the vicinity of the chosen frequency o. 

Physically, the power spectrum is real and non-negative: 


W(o) z 0 (7.10) 


This property imposes rather rigorous constraints on the form of 
the permissible autocorrelation functions. (We have already run 





* The alternative terms are the power density spectrum (Handbook of 
Automation, Control and Computation, Ed. Eu. M. Grabbe, S. Ramo, and 
D. E. Wooldridge. New York: John Wiley and Sons, Inc., 1958), the spectral 
density (C. W. Helstrom, Statistical Theory of Signal Detection. Oxford: 
Pergamon Press, 1968) the power spectral density (L.E. Franks, Signal 
Theory. Englewood Cliffs, New Jersey: Prentice Hall Inc, 
1969).— Translator's note. 
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into a similar situation in Chap. 3 in connection with the 
correlation properties of deterministic signals.) 

One more important point should be stressed. The power 
spectrum of a stationary random process, being always real, does 
not carry any information about the phase relations between the 
individual spectral components. Therefore, it is impossible in 
principle to reconstruct any individual realization of a random 
process from its power spectrum. 

The one-sided power spectrum. Since K (1) is an even function of 
t, the corresponding spectrum W(q) is likewise an even function of 
the frequency co. Therefore, the Fourier transform pair, (7.7) and 
(7.8), can be written, using only the integrals between semi-infinite 
limits: 


K(1)= - f W(o)cosot do (7.11) 


"e 


W(o)=2 i K(t)coswt dt (7.12) 
0 


It is expedient to introduce the so-called one-sided power spectrum 
F(@) of a random process, by defining it as follows: 


W(o)/nx for o>0 


7.13 
0 for o <0 ( ) 


F(o)= 
The function F(w) makes it possible to express the variance of 
a stationary random process as an integral over positive (entirely 
real or physical) frequencies: 


D 

o? = K(0)— f F(@)do (7.14) 
0 

By the same token, we may define the one-sided power spectrum 


F(f) which is the mean power in the process per unit frequency 
interval (1 Hz): 


2W! 
F(f- Qnf for f>0 
0 for f<0 
such that 
o= [ F(f)df 
0 


The W-K theorem is a most important tool in the applied theory 
of random processes and comes in useful when handling a large 
variety of problems. Consider some of the most typical examples. 


Ch. 7 The Correlation Theory of Random Processes 193 


Example 7.1. A random process with an exponential 
K autocorrelation function. 
Suppose we know that the process X(t) has an autocorrelation 
function of the form 





© K(t)=07exp(—at/) 


0 in which « is some real and positive parameter. On the basis of 
Eq. (7.12), the associated power spectrum is 


0 
W(@) = 20? f exp( — at)coswt dt = 2x0? /(x7 + o?) 
0 


Hence, the one-sided power spectrum is 
0 F (@) = 2/1) ac? (a? + o?) 


From the accompanying plot it is seen that the power spectrum of 
the process in question has a well-pronounced low-frequency 
character -the power spectrum is a maximum at frequency zero. 

Example 7.2. Suppose that the power spectrum of a random process 
X(t) is described by a Gaussian function (a quadratic exponential 





function) 
W(a) = W exp( — Bo?) 
K Let us find the autocorrelation function by using Eq. (7.11): 


oO 


K (x) =(Wo/n) f exp( — Bo?)cosox do = (Wo /2)/(1/nB) exp ( — 12/48) 
0 


t Thus, a Gaussian power spectrum leads to a Gaussian 
0 autocorrelation function as well. 
The variance of the random process in question is 


c? = W,/2|/np 


Example 7.3. A stationary random process with a band-limited low- 
frequency power spectrum. 

Let the process X (t) be characterized by a power spectrum of the 
form 


W(o) = f 





W, for — @lim < 0 < Olim 
0 elsewhere 
Using Eq. (7.11), we find the autocorrelation function to be 


K(i) = (W/m) f. cos ode = (Wo oiim/n) sin axi trim) 
0 





The variance of the process is 
c? = K (0) = W, Güim/r 
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In this case, it is convenient to use the one-sided power spectrum 
F(o)= | 
which makes it possible to write the expression for the variance as 


an easy-to-memorize product of the power spectrum by the fre- 
quency band occupied by the signal: 


Fo =(Wo/n) for 0< © < Olim 
0 elsewhere 


o? = Fo Olim 

It is important to note that the autocorrelation function of the 
process in question takes alternate signs, the change of sign 
occurring at each shift t which is a multiple of z/ojig. In other 
words, as t increases, the mean of the product x (t) x (t + x) will first 
be positive, then negative, then again positive, and so on. This 
behaviour of the  autocorrelation function points to the 
quasi-periodicity of any realization of the random process (of course 
in a probabilistic rather than absolute sense). 

From a physical point of view, the quasi-periodic realizations of 
random processes occur when the random waves are sums of 
a large number of independent r.f. pulses. 





A quasiperiodic reali- 
zation 





The correlation time. In general, the random processes of concern 
to statistical communication theory have the following property: 
Their autocorrelation function K (x) approaches zero as the time 
shift t increases. The faster the decrease in K (x), the weaker is the 
statistical relation between the instantaneous values of a random 
signal observed at two different instants of time. 

It is convenient to evaluate numerically the rate of change of 
realizations of a random process in terms of the correlation time 
Tecor, defined as 





tor => f K(1)dt= f R(t)dt (7.15) 


0 Toor 


The two shapes are Roughly speaking, we can predict in probabilistic terms the 
the same in area behaviour of any realization of a random process over the time 
interval tcor, if we know the behaviour of this realization in the 
“past”. Any attempt, however, to predict this behaviour for a time 
substantially exceeding the correlation time would be futile—beyond 
that interval isntantaneous values of the process are nearly 
independent random variables, that is, the mean value of the 
product x(t)x(t+ t) is close to zero. 

The effective bandwidth. Let the random process in question be 
characterized by a one-sided power spectrum, F(w), such that 
Fmax is the extremal value of the function. Mentally we may replace 
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this random process with any other process in which the power 
spectrum is constant and equal to Fmax within the frequency band 
A@ep chosen such that the mean power is the same in both 
processes: 

oO 


Fmax A®eff = f F (o) do 
0 


Hence the expression for the effective bandwidth of a random 
process is 


oO 


Amer = (1/F max) f F (©)do (7.16) 
0 


This numerical characteristic is frequently used in engineering 
calculations as it provides a ready means for finding the variance of 
a noise voltage: 


oF max A@eff 


For example, if we know that Fmax = 5 x 10 ?V? s and Aef = 
=3x10°s7', then o?= 1.5 x 10? V2, Hence, the rms noise 


voltage is o = Vo? = 39 mV. 

Obviously, the effective bandwidth of a random process can be 
specified in more than one way. For example, it may be defined as 
the interval at whose boundaries the power spectrum decreases to 
0.1F max. In any case, the correlation time tcor and the effective 
bandwidth Acer will be connected by the uncertainty relation 


A@®efftcor = O (1) i 
arising from the properties of Fourier transforms (see Chap. 2). 
Thus, the broader the bandwidth of noise, the more chaotically its 
realizations vary with time. 

White noise. In communication theory, the term “white noise” 
refers to a stationary process whose power spectrum is the same at 
all frequencies: 





W(o) = W = const 


The term “white noise” suggestively stresses the analogy with 
“white” (natural) light in which all the spectral components within 
the visible region have about the same intensity. 

By the W-K theorem, the autocorrelation function of white noise 


K() =(W/2m) ij exp (jot) do = 1%3(t) (7.17) 
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which is an indication of an infinitely large mean power in white 
noise. 

Alternatively, white noise is referred to as a delta-correlated 
random process. The uncorrelatedness of instantaneous values of its 
realizations implies that they vary with time at an infinitely high 
rate: However small the time interval t may be, the instantaneous 
value of the signal can change over that time by any value we may 
like to specify in advance. 

White noise is an abstract mathematical model, and a physical 
process answering this model is, of course, non-existent in nature. 
This does not prevent, however, using it as an approximation for 
sufficiently broadband real random processes in cases where the 
passband of the circuit responding to the signal is substantially 
narrower than the effective bandwidth of the noise. 


7.2 Differentiation 
and Integration of Random Processes 


In this section, we will be concerned with the properties 
displayed by realizations of random processes subjected to 
differentiation and integration. It will be shown that the most 
important characteristic defining the differentiability of a random 
process is its autocorrelation function. 

Probabilistic treatment of convergence and continuity. In the 
theory of random processes we have somewhat to extend the 
classical concept of the convergence of a sequence of numbers 
towards their limit. Thus, if {xn} is a random sequence, then it is 
not always that in the limit m, n — oo the difference |x, — x,| should 
be less than any predetermined number, however small. 

A random sequence {xn} is said to converge towards 
a nonrandom number x in probability if, for any €> 0, 

lim P(|x,—x|>«)=0 (7.18) 


n-*o0 
The requirement for convergence in probability, apphed in all 
problems involving random processes, is less rigorous than the 
classical criteria for the convergence of deterministic sequences. 
The property of continuity for a random process is defined in 
a similar way. A random process X (t) is said to be continuous at 
point t= tg, if the following limiting equality is satisfied 


lim [x(t,) — x(t)]? 20 (7.19) 
tisto 
The derivative of a random process.Suppose that any realization 


x(t) of a random process X(t) can be applied to a differentiating 
network which produces at its output a new realization y(t)= 
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= dx/dt. The collection of realizations y(t) forms a random process 
Y(t) called the derivative of the process X (t). Symbolically, this is 
stated as follows: 


Y(t) 2 dX/dt 

Let X (t) be a stationary random process of a known mean value 
x = m,. In order to find the mean of the derivative, we should take 
the average over realizations: 


=. g 
my =} =dx/dt = meg (7.20) 


To sum up, the differentiation of any stationary random signal 
produces a new random signal of mean value zero. 

Finding the autocorrelation of a derivative poses a more difficult 
problem. Without loss of generality, let us suppose that the mean 
value of the original process is mx = 0. (If this should be not the 
case, we may always choose a new process X (t) whose realizations 
are X(t) = x(t)— mx.) Taking advantage of the fact that 
dx x(t + At) — x(t) 


— — lim 
dt 4:40 At 


we may write the autocorrelation function of the derivative as 


Ky(t)= y(t) y(t + 1) 





= lim x(t+At)—x(t) x(t+t+A—x(t+7) 
At20 At At 








ple 
= lim ——-! x(t + At)x(t+1+ At) 
Ar? 0 (At)? L 


a 
—x(t4- A)x(t+1)—x@x+t+AN+xOx t+ 5 | 


The four terms within the square brackets are the autocorrelation 
functions of the original process, as found for various values of time 
delay. It is an easy matter to see that 


1 
K,(t) = lim - 


The right-hand side of the above equality can be recognized as 
a finite-difference representation of the second derivative of Kx (t), 
taken with the opposite sign. This leads us to an important formula 


Ky(t)= — Ki(t)= — 02 R"(t) (7.21) 
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Differentiable and  nondifferentiable random processes. By 
definition, a random process X (t) is differentiable if its derivative 
has a finite variance. 

In accord with Eq. (7.21) the variance of a derivative is 


of = — Kx(0)= — o£R"(0) 


Therefore, for a random process to be differentiable it is necessary 
that the second derivative of its autocorrelation function be finite at 
zero-crossing and, in consequence, the first derivative be continuous 
at that point. 

Nondifferentiable random processes are those for which the 
autocorrelation function is of the form o?exp(— altl), considered 
in Example 7.1. On differentiating this function, it can be easily 
seen that at zero-crossing the derivative changes in magnitude 
stepwise by — 20?a. 

In communication theory one has often to deal with random 
processes whose autocorrelation functions have the form 


K(t)=07(1 + @|t))exp(— altl) (7.22) 
The first derivative of the above function 


— a?o?xexp( — at) for t>0 
K'(0)- 25 
—a’o*texp(at) for c «0 


is continuous at zero-crossing, so the autocorrelation function in 
(7.22) is associated with a differentiable process. Any real random 
signals are always sufficiently continuous, that is, they are 
differentiable. In theoretical studies, however, use is often made of 
mathematical models corresponding to nondifferentiable processes. 
As a rule, this is the case when realizations of a random process are 
formed from a large number of independent variables. Although the 
contribution by one such variable (say, the current pulse produced 
by the motion of a single electron) is negligible, precisely these 
components determine the “fine structure’ of the realization. In 
consequence, realizations of such a process can, in the limit, take 
the form of a function everywhere continuous, but nowhere 
differentiable. 

The power spectrum of a derivative. We set out to establish the 
relation between the power spectra of an original process and of its 
derivative. Let X(t) W.(o). By the W-K theorem, the 
autocorrelation function of the original process is 

e 


K«()— 5— | We(o)exp(jor)de 


On the basis of (7.21), the autocorrelation function of the 
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derivative is 

1. % 
Ky) => J œW, (o)exp (jot) do 
Hence, the sought-for relation is 


W, (c) = 0? Wx (0) (7.23) 


It is worth noting that the low-frequency components in the 
power spectrum of the derivative are weakened and the high-fre- 
quency components are boosted. On the basis of Eq. (7.23) we can 
say whether the process X (t) is differentiable from the properties of 
its power spectrum: The variance of the derivative will be finite, if 
the integral 


o} = — f e?W(e)do « +0 
^^ 2n 
exists. 
For example, in the case of a random process having a low-fre- 
quency power spectrum (see Example 7.3) the variance of the 
derivative is 
Olim 
02-(W,2n) f œ? do = W;oj,/31 


7 Dim 


-0 


Therefore, the process involved is differentiable. 

Correlation between a random process and its derivative. In 
many communication-theory problems it is interesting to know the 
extent to which a random signal and its derivative are related to 
each other statistically. In order to answer this question, let us find 
the cross-correlation function Kx (t) of the random processes X (t) 
and Y(t) 2 dX/dt, assuming that both are stationary and of mean 
value zero. Then 


Kod = X(y( 9) = xt) xt) = OMT 9 


Hence, 
Kxy(1) = dK, (t)/dt (7.24) 


As will be recalled, the function Kx(t) shows even symmetry. 
Therefore, for t — 0, the derivative dK,./dt vanishes always. On the 
basis of Eq. (7.24), we may conclude that the instantaneous values of 
a signal and of its derivative, observed at the same instant of time, are 
uncorrelated random variables. A stronger assertion can be made 
with regard to Gaussian random processes. Here, a random signal 
and its derivative are statistically independent. 

The integral of a random process. Let the random process Z (t) 


Resort is made to the 
differentiation of an in- 
tegral with respect to 
the parameter 


E 

A random process and 
its derivative are un- 
correlated 
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be called the variable-upper-limit definite integral of a random 
process X (t) if the following correspondence exists between their 
realizations z(t) and x(t): 


z(t)= J x(t,)dt, (7.25) 


The physical significance of this is that the signals z(t) are observed 
at the output of an ideal integrator, with the input signals x(t) 
commencing to arrive at time zero. 
If the process X (t) is stationary and of mean value mx, the mean 
value of the signal at the output of the integrator will be 
t 
m; = Z(t)= [x(t)dt, = m« (7.26) 
0 


Thus, the condition m, # 0 immediately leads to the nonstationarity 
of the random process Z (t). 

However, even if the input signal is of mean value zero, the signal 
at the output of an ideal integrator will be a realization of 
a nonstationary random process. To prove this, let us find the 
autocorrelation function of the integral: 

ht 


Kz(t,, t)- f f x(¢)x(e)de'de’ 
00 





titz ti t2 


= | | xx (drat = [ f Kx, mara 
00 00 


If the process X(t) is stationary, the argument of the 
autocorrelation function under the integral in the above equation 
will be the time difference t" — t’, so 

fi t 
Kz(t,, t) = f | Kx(t" — t)ar'de (7.27) 
00 
Since the right-hand side of Eq. (7.27) depends directly on t, and 
t,, rather than on their difference, the signal at the integrator out- 
put cannot be a stationary random process. 

The nonstationarity of the integral of a random process has an 
important physical significance - it implies that the level of fluc- 
tuations at the output of an ideal integrator rises without bound 
due to their accumulation. 

Similar situations are frequently encountered in various fields of 
physics. An example is the well-known one-dimensional random 
walk of a particle (the Brownian motion) [14]. Here, the imaginary 
particle, on being equiprobably hit in two opposite directions, 
remains on the average in the same place, but its deviation from the 
mean position increases without bound in time. 
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The crossing problem. In statistical communication theory, the 
following problem related to the differential properties of random 
processes is of special interest. Suppose that realizations of some 
random process X (t) are sufficiently continuous functions of time. 
It is required to determine how frequently these realizations cross 
some fixed level xy. This problem naturally arises in, say, the 
noise-immunity analysis of communication systems subjected to 
fluctuation or random pulse noise. 

An event consisting in that a realization x(t) crosses the specified 
level xy in the upward direction can be called the upward crossing 
of the process X (t) at the level xg. 

Let us solve a very simple problem — we seek to find the average 
number of upward crossings per unit time. To this end, we mentally 
select on the f-axis a short interval of length or duration At. 
Assuming that the process X (t) is stationary and continuous, it is 
always possible to specify so small an interval At that no or only 
one upward crossing will occur within it. 

To begin with, we find the probability of the elementary event 
consisting in that in time At one upward crossing takes place. 
Obviously, it can occur if: 


(a) x(t) « xo and (b) x(t - At) > xo 

Since 

x(t + At) X x(t) - x'At 

the condition (b) implies that 

Xo — X'At « x(t) * 

Thus, a single upward crossing inside the interval At will take place, 
if the realization of the random process in that interval has 


a positive derivative, or an upward slope (x' 2 0) and satisfies the 
inequality 


Xo — X'At < x(t) € xg 


The probability P of the above event is easy to find if we know 
the joint bivariate probability density p(x, x’) of the realization and 
of its derivative, related to the same instant of time: 


Xo 


P=fdx' f p(x, x) dx— At f p(xo, x)x' dx' (7.28) 
0 


0 Xo- X'At 


The direct proportionality between the probability in (7.28) and 
the duration of the time interval At is an indication that the 
quantity n(x,), the average number of upward crossings per second 
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(or the crossing rate) can be defined by 
n(xo) = f pxo, x)x dx' (7.29) 
0 


Crossings of Gaussian processes. The average number of upward 
crossings is far simpler to find if the process X (t) is Gaussian. Then 
the instantaneous values of a realization and of its derivative 
Observed at the same instants of time are statistically independent, 
that is, 


Po. x)= p(Xo) p(x’) (7.30) 


Also, the derivative, obtained as a result of linear operations on the 
original process, is likewise normal. On combining (7.29) and (7.30), 
we get 


ile) = pio) ei (131) 


Suppose that we know the autocorrelation function 
Kx (t) = o2 R(t) 
of the process. Then the variance of the derivative will be 
ox = —oiR'(0) 


Hence, the probability density of the derivative is 


"T 7 x 
P0) Vox RO | 2o2[ - RO] | 


By simple manipulations, we get 


(7.32) 





y: 1 —— 

f p(x’)x’ dx’ 2 ——o,|/ — R” (0) 

0 2r 

On substituting the above expression into (7.31), the average 
number of upward crossings per second for a stationary Gaussian 
process is found to be 


n(xo)= (1/22) V/ — R"O)exp(— x2/203) (733) 


The quasi-frequency of a stationary random process. In Sec. 7.1 it 
has been noted that some forms of random processes vary in time 
quasi-periodically. The numerical measure defining the rate of such 
variations is the quasi-frequency defined as the average number of 
zero-crossings per unit time. By virtue of Eq. (7.33), the quasi-fre- 
quency for a Gaussian process 
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1 ————— 
n(0)= -> V — R'(0) (7.34) 


is wholly defined by the behaviour of the autocorrelation function 


at zero. Since Quasi-frequency can 
— R'(0) = 0%/o% only be determined 

. — . for a differentiable 
and the variance of the derivative is expressed in terms of the random process 


one-sided power spectrum of the process X (t): 


of = f o? F.(o)do 
0 


then the quasi-frequency may be re-cast in a form equivalent to 
that of Eq. (7.34): A 


E ii " Solve Problem 9 
n(0) - —— [f e? F(v)do]'? (735) olve Problem 
2nox $ 





Example 7.4. The quasi-frequeucy of a stationary Gaussian process 
with a band-limited low-frequency power spectrum (see Example 7.3). 
Here, 


J oF x(@)do = Foo, /3 
0 
9x = |/ Fottlim 


On substituting the above expressions into Eq. (7.35) we get 
n (0) = cxim/2n |/3 = fiim/V/ 3 


The final result cannot be found directly. 


7.3 Narrowband Random Processes 


An extremely important role in telecommunications is played by 
a special class of random processes a salient feature of which is that 
their power spectrum has a sharply defined peak around a certain 
nonzero frequency. What follows is an analysis of the statistical 
properties of such narrowband random processes. The exposition is 
limited to the case of Gaussian processes most frequently 
encountered in practice. Also, it is for Gaussian processes that 
a number of important results can be obtained within the 
framework of correlation theory. 

The autocorrelation function of a narrowband random process. 
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We consider a random process X(t) whose one-sided power 
spectrum F(w) is concentrated in the vicinity of an arbitrarily 
chosen frequency 9. 
By the W-K theorem, the autocorrelation function of the process 
in question is 
oo 


K(x) = f F(o)cos ox do (7.36) 


Let us mentally shift the power spectrum of the process from the 
vicinity of frequency o, into the vicinity of zero frequency by 
a change of variable, o = o9 +Q. Then Eq. (7.36) takes on the 
following form: 


K(t)= f F (o + 9) cos [(@ + Q)t] dQ (7.37) 


— o 


Since we have assumed that the process X (t) is narrowband, its 
power spectrum F(@) is vanishingly small at frequencies close to 
zero. Therefore, we may, to a high degree of accuracy, replace the 
lower integration limit in Eq. (7.37) with — œ and re-write the 
autocorrelation function as 





K (1) = a(t)cos @pt — b(t) sin Mot (7.38) 





where 


a(t)= f F(a) +Q)cosQrdQ 


and 
b()- f F(@)+Q)sinQrdQ 


are slowly varying functions of the argument t. It is to be noted 
that a(t) is even and b(t) is odd about t. 

The autocorrelation function of a narrowband random process is 
especially simple and straightforward when the power spectrum 
F(@) is symmetrical about its centre frequency og. Then b(t)=0 
and 
K (1) = a(t) cos ost (7.39) 
The factor a(t) plays the role of an envelope which varies more 
slowly than the factor cos ost. Frequently it is convenient to invoke 


a normalized envelope, p(t) for the autocorrelation function of 
a narrowband random process, by defining it as 


a(t) = ox p(t) 
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Then, 





K (t) = 0%p(t)cos@ot (7.40) 





The envelope and the initial phase. The form of the 
autocorrelation function in (7.40) implies that the individual 
realizations of a narrowband random process are quasi-harmonic 
waves 


x(t) = U (t) cos [wot + o(t)] (7.41) 


in which both the envelope U(t) and the initial phase ọ (t) are 
random functions varying slowly (in scale of c). 

Let us write the realization defined in (7.41) as the sum of its 
in-phase and quadrature components (see Chap. 5): 


x(t) = A(t)cos@ot — B(t)sin Wot (7.42) 


The two amplitudes, A(t) and B(t), are likewise slowly varying 
signals, and their variations grow progressively slower as the 
effective bandwidth Ace; decreases in comparison with the centre 
frequency Ge. 

Consider a random process Y(t) which is the conjugate of the 
original random process X(t) Its realizations are found by the 
Hilbert transform: 


1-9 d 
yO=— | ^o) = 





The assumption that the in-phase amplitude A(t) and the quadra- 
ture amplitude B(t) vary slowly enable us to write a fairly simple 
expression for a realization of the conjugate process by placing the 
slowly changing terms outside the Hilbert transform 


y(t) = A(0sinogt + B(t)cosWot (7.43) 
Hence follow the expressions for the instantaneous values of 
a realization of the envelope 

U()- x? + y! =// A(t) + BN) (7.44) 
and of the initial phase 


B(t) 
A(t) 


Statistical properties of the conjugate process. For a further 
analysis of the envelope and initial phase of a narrowband random 
process, we must establish the relation between the statistical 
characteristics of X(t) and Y(t). 

To begin with, it is to be noted that if x = 0, then y — 0 as well. 





(745) 





Q(t) — arc tan 





A typical realization of 
a narrowband random 
process 
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Also, since X(t) is a Gaussian process, and the Hilbert 
transformation is a linear integral transformation, then the 
conjugate process Y(t) has the property of normality as well. 
As will be recalled, if S,(@) is the spectrum of the realization x (t), 
then the corresponding spectrum of the conjugate realization will 
be 
Sy) = —jSx(w)sgn (o) 
The magnitudes of $x(@) and Sy() are the same, so the power 
spectra of X (t) and Y(t) are the same, too: 
Wo) = Wo) 
Hence we may conclude that the two processes have an identical 
autocorrelation function and that Y(t) is a stationary process: 


K,(t) = Ky(t) = j F,.(@)cos tdo 
0 


Finally, let us find the cross-correlation function 


*ox(x(). 





———— l 
Kyy(t)= ) =— E 
y SOES "eem $ 
ol 7 Kx(%-t) u b Kx(n) 
= ment. | i9 ^ 


—00 


which is the same as the Hilbert transform of the autocorrelation 
function of the process X (t). Similarly, it can be shown (this is left 
as an exercise for the reader) that 


Kyx(t) 2 — Kx,(t) 

Thus, 

Kx) = H[Kx(t)] = f Fx (@)sin atda (7.46) 
0 


Interestingly, the function K,xy{t) shows odd symmetry and 
vanishes at t = 0. Hence, the processes X (t) and Y(t) are statistically 
independent at the corresponding instants of time. Equation (7.46) 
can be re-cast in a more convenient form on making a change of 
variable, o = o + Q. Then 


Kyy(t)= f Fx(@p + O)sin (e + Q)tdQ 
- Mo 
= a(t)sin WoT + b(x)cos oot (7.47) 


where the functions a(t) and b(t) are defined as in (7.38). 
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Correlation properties of the in-phase and quadrature 
amplitudes. We seek to find and analyse the statistical 
characteristics of the envelope U (t) and of the initial phase ọ (t). 
For this, it is convenient to replace the realizations x(t) and y(t) 
with the slowly varying realizations A(t) and B(t) which, on the 
basis of Eqs. (7.42) and (7.43), can be defined as 
A (t) = x (t)cos ag t + y (t) sin Wot 

(7.48) 
B(t)= — x(t)sin gt + y(t)cos oet 


The processes A(t) and B(t) are linearly related to the Gaussian 
processes X(t) and Y(t). Therefore, they, too, are Gaussian, and if 
x=y=0, then A= B=O, as well. 

Let us take the first line in Eqs. (7.48) and find the 
autocorrelation function of the process A(t), By simple 
trigonometry, we obtain 


KA4(1) = [x(t)cos Mot + y(t)sin egt] [x(t + x) cos wolt + x) 
+ y(t 4 x)sin c(t + 1)] 
= Kx(t) cos pt + Kxy(1)sin Got (7.49) 


Substituting for Kx(t) and Kx,(t) from (7.38) and (7.47) yields 
a very simple result: 


K,4(t)= a(t) (7.50) 

Similarly, it is proved that 

Ka(t)= a(t) (7.51) Work Problem 10 
and ° 

Kap(t) = b(t) (7.52) 


On setting t=0 in (7.50) and (7.51), we obtain 


o4=o%= f F(a)do=o% (7.53) 


Thus, the variances of the in-phase and quadrature amplitudes 
are equal to the variance of the original narrowband process X (t). 

The joint probability density of the envelope and of the initial 
phase. The advantages of the procedure in which the narrowband 
random process is replaced with its in-phase and quadrature 
components become obvious when we are to find the bivariate 
probability density p(U, ©). This characteristic, in turn, enables us 
to find the univariate probability densities of the envelope 

2n 


p(U)- f p(U, ọ)dọ (7.54) 
0 
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and of the initial phase 


P(9)= f pU, p)dU (7.55) 


The instantaneous values of A(t) and  B(t) form 
a two-dimensional Gaussian vector variable the two components of 
which are independent and have the same variance o2. Therefore, 
the bivariate probability density is 


exp[ — (A? + B?)/20%] (7.56) 





p(A, B)= p(A) p(B) = Ino? 


In order to obtain the probability density p(U, «), we should 
transform the random vector {A, B} into a new random vector 
(U, 9}: 

A=Ucoso, B=Using (7.57) 


The Jacobian of such a transformation (see Eq. (6.24)) is 


_ |cos -Usino| ,, 


D- (7.58) 


sin 9 U cos @ | 7 
Since in the new variables 
A? + B? =U? 


it follows then that the expression for the sought-for bivariate 
probability density is 


p(U, 9) =(U/2no%)exp(— U?/20%) (7.59) 


The univariate phase distribution. Taking advantage of Eqs. 
(7.55) and (7.59), let us find the probability density of the initia) 
phase: 

l 


p(o) = .—. | (U/oS)exp( — U?/202)dU 


By a change of variable, z= U/ox, we get 
(p) — f í e Capi (7.60) 
PT x J? = ^ 2x f 


Thus, the initial phase of a narrowband random process is 
distributed uniformly in the interval from O to 2r. Physically, this 
means that all values of the initial phase of individually taken 
realizations are equally significant. 

The univariate envelope distribution. Since p(U, ọ) is not an 
explicit function of o, then, by virtue of Eq. (7.54), the probability 
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density of the envelope is 





p(U) = (U/o3)exp( — U?/202) (7.61) 


It is advisable to change back to the nondimensional variable z = 
= U/ox, for which 


p(z) =zexp(—z?/2) (7.62) 


The distribution of the instantaneous values of the envelope of 
a narrowband random process as defined by Eq. (7.61) or (7.62) is 
known as the Rayleigh distribution. The applicable plot in Fig. 7.1 
demonstrates that only some of the average values of the envelope 
(the orders of ox) are most probable. On the other hand, it is very 
unlikely that the envelope can take on values either very close to 
zero or substantially exceeding the rms level, ox, of the original 
process. 


0.4 


0.2 


z 
0 *1 2 3 


Fig. 7.1 Plot of the probability density for a Rayleigh-distributed random 


variable (with the dimensionless argument z = U/o, laid off as abscissa) 


By averaging on the basis of the distribution in (7.61), we can 
find the mean value of the envelope of a narrowband random 
process: 


my = U=|/n/20x = 1.2536, (7.63) 
and its variance: 
ot = U? — U? = (2 — 2/2) o} = 0.42902 (7.64) 


The univariate probability density of the envelope enables us to 
solve many problems in the theory of narrow-band random 
processes, notably to find the probability of the envelope exceeding 
a definite specified level. 
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Example 7.5. Let a narrowband normal process have a constant 
one-sided power spectrum Fg — 1.5 x 107? V? s in the frequency 
band from «min — 105s^! to @max=1.02x105s~1. Find the 
probability that the envelope of this process will exceed the level 
U - 5 V. 

From the statement of the problem, the effective band-width of 
the process is 


A@ep = 2 x 107 s7! 

Therefore, the variance is 

ox = FoAmeft = 3 V? 

From. the definition of the probability density, the sought-for 
quantity 1s 


P(U > Uo) = í p(U)dU = exp( — U;/202) 
U, 


— exp( — 25/6) 2 0.0155 


It may be argued that the event considered in this example is 
a rather seldom occurrence. 





Rayleigh-distributed random variables arise in many physical and 
communication problems. The elegant derivation of Eq. (7.61) 
obtained by Rayleigh from entirely different assumptions can be 
found in a classic book [43]. 

The bivariate probability density of the envelope. For a proper 
insight into the behaviour of the envelope in time, it is essential to 
have a more detailed information as compared with that obtainable 
from the Rayleigh distribution. For example, if we wish to calculate 
the autocorrelation function of the envelope, we need to know the 
bivariate probability density p(U, U,). (Here and elsewhere, U;— 
= U(t+7).) 

Let us take advantage of the fact that the in-phase and quadra- 
ture amplitudes of a narrowband normal process are low-frequency 
Gaussian signals having the same autocorrelation function 


K4(1) = Ka(t) = oxp (1) 
and the following bivariate densities [see (6.28)]: 
a de eo bel - Acne 
p(A, Ad = ————— 00——MELg— 
2noi|/1— p? i 20% (1 — p?) 
l |- LEONE 


B, = 
diode ud 2610 — p?) 
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If the power spectrum is symmetrical about the centre frequency 
Q9, such that b(t)=0, the processes A(t) and B(t) are statistically 
independent, and so their joint quadrivariate probability density is 


p(A, Ax, B, B) - p(A, Ax) p(B, By) (7.65) 


Let us change from the in-phase and quadrature amplitudes to the 
envelope and the phase observed at different instants of time: 


A=Ucoso; Ar=Ur;cos@r 


(7.66) 
B=Using; B:= Ursin o: 
The Jacobian of the above transformation is 
cos @ 0 sin Q 0 
D= " COS (x 0 sin q« - UU, 
—Using 0 U cos o 0 
0 — U«sin qx 0 U cos q« 
(7.67) 


Using the above result, we can write the probability density (7.65) 
in terms of the new variables: 


UU, 
41? o%(1 — p?) 

| U? +U} — 2p UU«cos(o — 9x) | 
xexp| — ———— ———-— 


p(U, U,, g, 1) = 


7.68 
2530 - pj E 
Now, in order to obtain the sought-for bivariate probability 
density of the envelope, we should integrate the right-hand side of 
Eq. (7.68) with respect to angular coordinates twice: 
2T 2n 


p(U, U:)= f do f do;p(U, Ur, Ọ, 9x) (7.69) 
0 0 


By applying a representation known from mathematics 
1 27 
x J exp(xcoso)do = Io (x) 
21 9 


where I, is a modified Bessel function of order zero, from 
Eqs. (7.68) and (7.69) we finally get 


UU, U? +U? pUU, 
U, U) = ——— —- — I 7.70 
iad scr 3otü - 5 ^| ei — 95 |" 








To 


— NOU 4 t^ 


1 1 Lx 
0 1 2 3 


The function 7j (x) 
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e 
The bivariate Rayleigh 
distribution 


A. 
Solve Problem 12 


Part One. Signals 


The probability density defined by Eq. (7.70) is sometimes called 
the bivariate Rayleigh distribution. Interestingly, if the time shift 
1 substantially exceeds the correlation time tco; associated with the 
function p(t), then p —O and, since I5 (0) — 1, we have 


p(U. U,)=(U/o%) exp( — U*/20%)(U /ox)exp(— U7/20%) — (7.71) 


that is, p(U, U&) tends towards the product of two univariate 
Rayleigh densities. 

The autocorrelation function of the envelope. By definition, 
Ky()- UU,- U? (7.72) 

On the basis of Eq. (7.63), the square of the mean of the envelope 
is 
U? = (n/2) 02 

Therefore, the task reduces to calculating the mean value of the 
product UU.: 


UU,= [dU f dU,p(U, U)UU, (7.73) 
0 0 


The evaluation of the integral in (7.73) involves a good deal of 
computational work because the bivariate probability density (7.70) 
expands into an infinite series of Laguerre polynomials [15]. 
Omitting the intervening manipulations, the final result can be 
written as 


T p? & [(2n—3)!!]}? ,, 
Kut)- Sot + Parco (7.74) 


On writing the autocorrelation function as 
Ku(t) = ct Rut) 


we find from (7.74) the following expression for the correlation 
coefficient of the envelope: 


Ru (t) = 0.915p? (1) + 0.058p* (x) + ... (7.75) 


In approximate calculations, it is legitimate to take the correla- 
tion coefficient of the envelope as being equal to the square of 
the envelope of the autocorrelation function of the narrowband 
signal. 








Example 7.6. Let it be known that the autocorrelation function (in 
V?) of a random process is 


K,(t) = 0.5exp( — 10*/« |) cos2x x 10° 
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Since the high-frequency component has a period of 107° s, and 
the amplitude coefficient changes in the meantime by a factor of 
only exp( — 1072) 2 0.99, the random process in question may be 
taken as a real narrowband process with a centre frequency f, — 
—1 MHz. Retaining only the first term in the series (7.75) and 
replacing the coefficient 0.915 approximately with unity, the 
correlation coefficient of the envelope is found to be 


Ry(t)Xexp(—2 x 10*|t]) 
The variance of the envelope is 
of = 042962 = 0.2145 V? 
Hence, the autocorrelation function of the envelope is 
Ky(t) = 0.1963 exp(— 2 x 10*|t]) 
The correlation time of the envelope 


oo 


Toor = | Ru(t)dt=0.5 x 1074 s 
0 


is equal to 50 periods of the harmonic wave of frequency f,. 
Finally, the one-sided power spectrum of the envelope (see Example 
7.1, whose dimension is V? s, 


2.73 x 10? 
4 x 1085 - o? 
is concentrated in the low-frequency region. 


Fy(o)= 





The envelope of the sum of a harmonic signal and a narrowband 
Gaussian noise. In communications engineering, it is often 
important to know the statistical regularities of the signal observed 
at the output of a frequency-selective device, such as a tuned 
amplifier. Here, the Gaussian fluctuation noise at central frequency 
Og equal to the resonance frequency of the system is present along 
with a deterministic signal Um cos oot of a known amplitude Um. 
If the message transmitted over the communication system is 
embedded in the envelope of the output wave, as is the case with 
amplitude modulation, it is important to learn the extent of signal 
corruption due to noise. 

The simplest problem is to find the univariate probability density 
for the envelope of the aggregate waveform. Assuming that the 
signal is 
s(t) = U «cosogt 
and the fluctuation noise is 
n(t) = A(t) cos ogt — B(t) sin Wot 


we may write the following expression for a realization of the 
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@ 
The Rice distribution 


Part One. Signals 


aggregate process x(t): 
x(t) = s(t) + n(t) = [Um + A(t) ] cos oot — B(t) sin Mot 
This is a narrowband process, therefore its realization may be 
written in terms of the slowly changing envelope U (t) and of the 
initial phase ọ (t): 
x(t) = U (t)cos [oo (t) + o (t)] 

Obviously, there is a relation between the pairs {A, B} and {U, 
9] such that 
A= U cosp— Um 
B = U sinọ (7.76) 


It is an easy matter to verify that the Jacobian D of the above 
transformation is equal to U. In consequence, since the bivariate 
probability density is 


l 
p(A, B)= p^ exp [ — (A? + B*)/20%] 


then in the new variables 


U? + U, 2UU moose 
202 ) 





U 
U, = X : 
p(U, 9) nat X (7.77) 
Now, in order to find the univariate probability density of the 
envelope, we should integrate the right-hand side of Eq. (7.77) with 
respect to the angular coordinate: 


2n 


p(U)- f p(U, o)do 


As a result, we get 
p(U) = (U/o%) exp [ — (U? + Uin)/20%] Ij (UU n/0%) (7.78) 


Equation (7.78) expresses the distribution law known in. 
communication theory as the Rice distribution. It is to be noted that 
for Um = 0, that is, in the absence of a deterministic signal, the Rice 
distribution goes over into the Rayleigh distribution automatically. 

Figure 7.2 shows the probability density function of 
a Rice-distributed random variable for several values of the ratio 
a = Uy /ox. 

Interestingly, if the amplitude of the deterministic signal is 
substantially greater than the rms noise level, that is, if Um/ox>1, 
then for U>U, we may use the asymptotic representation for 
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Fig. 7.2 Probability density of a Rice-distributed random variable 


modified Bessel functions with a large argument: 


exp(UUm/o%) _, oxexp(UU m/ox) 
V2x(UU,o3)  — 2nU 


On substituting in (7.78), we get 


1 
p(U)x 
V 210x 


That is, the envelope of the resultant signal is now an 
approximately Gaussian vatiable of variance oł and of mean value 
Un. 

For practical purposes it is legitimate to assume that even at 
Um/Ox = 3 the envelope of a narrowband signal is normalized. It is 
useful to recall that the Rayleigh-distributed envelope of pure noise 
has a variance of 0.42962. Thus, the increase in the amplitude of 
the deterministic harmonic signal more than doubles the variance 
of the envelope. Yet, the relative fluctuations of the envelope 
decrease. To demonstrate, for pure noise the ratio oy/U, which 
can serve as a convenient numerical measure of fluctuations, is 
0.523. In the case of a large deterministic signal, oy/U = © x/U m, 
tending to zero as Um increases. 


Ig (UU m/%) = 





exp[ — (U — Um)?/20%] (7.79) 
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The curve in colour 
answers the Rayleigh 
distribution 


A typical realization 
of the envelope of a 
narrowband noise 


U 


drana, 


0 


and a process which 
is the sum of a harmo- 
nic signal and narrow- 
band noise 


t 


Note variations in the 
mean and the variance 
due to the harmonic 
signal 


<> The random spectrum of the individual realizations of a stationary random process is 


delta-correlated and has mean value zero at all frequencies. 


<<> The Fourier transform of the autocorrelation function of a stationary random process 
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is called the power spectrum. As the power spectrum grows wider, the realizations of 
the random process become increasingly more random. 

For a random process to be differentiable, it is essential that there should exist the 
second derivative of the autocorrelation function, with the argument being equal to 
zero. 

The instantaneous values of realizations of a random process and of its derivative 
observed at corresponding instants of time are uncorrelated. 

The realizations of a random process appearing at the output of an ideal integrator 
form a nonstationary random process even when the input process is stationary. 
In the general case, the realizations of a narrowband random process are quasi- 
harmonic waves randomly modulated in amplitude and phase angle. 

The autocorrelation function of a narrowband random process is the product of 
a rapidly changing component and a slowly changing component. 

A narrowband random process and its Hilbert transform observed at corresponding 
instants of time are uncorrelated. 

The envelope of a narrowband Gaussian random process is Rayleigh-distributed; the 
initial phase of the process is uniformly distributed. 

The autocorrelation function of the envelope of a narrowband process is 
approximately equal to the square of the envelope of the autocorrelation function of 
the process itself. 

The envelope of the sum of a harmonic signal and of a narrowband Gaussian noise 
for which the centre frequency of the power spectrum is the same as the signal fre- 
quency is distributed by the Rice law. 

At large values of the signal-to-noise ratio, the envelope is normalized. 


Review Questions 


1 


2. 
3. 
4. 


A random process is studied within the framework of correlation theory. What is the 
meaning of the statement? 

State the Wiener-Khinchin (W-K) theorem. 

List the principal properties of the power spectrum of a stationary random process. 
Define the concept of one-sided power spectrum. If the power spectrum of a stationary 
random process is known, how can you find its variance? 

Why is it that random processes resembling white noise are called delta-correlated? 
What are the basic properties of white noise? In what cases may a real random process 
be approximated with white noise? 

Define the concept of convergence in probability. 

List the salient properties of nondifferentiable random processes. 

How does one find the variance, the autocorrelation function and the power spectrum of 
the derivative of a stationary random process? 

Define the notion of an upslope (positive-going) crossing of a random process. 
What is the quasi-frequency of a stationary random process? 


. Draw an approximate plot for a realization of a narrowband random process. 


List the basic properties of the in-phase and quadrature amplitudes of a narrowband, 
random process. 
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13. Why is it that the Hilbert transform of a Gaussian random process retains the property 


of normality? 


14. Draw the typical waveform of a Rayleigh-distributed random signal. 
15. Draw plots of the Rice distribution for several values of the signal-to-noise ratio. 


Problems 


1. Calculate the power spectrum of 
a stationary random process for which the 
autocorrelation function is 


ke f CIT) Iles 
0, | t | > to 
2. Find the power spectrum of 


a stationary random process for which the 
autocorrelation function is 


K (x) = o?exp( — B?x?/2)cosot 

3. The one-sided power spectrum of 
a stationary random process X (t) is defined 
by 
Fx(f) = A(f/fo)exp( —f/fo) 
where A and f, are constants. Determine the 
autocorrelation function of the process. 

4. A stationary random process has an 


effective bandwidth of 1.5 MHz. The 
maximum value of the one-sided power 


spectrum is 03x10 !?^ V? Hz !, De- 
termine the variance of the process. 

5. Find the correlation time for 
a stationary random process whose 


autocorrelation function has the form 
K(t) = o?exp( — a] t|) 


6. Assuming that the air temperature 
over a month is a realization of a stationary 
random process, estimate the correlation 
time. 

7. Find the variance for the derivative of 
a random process whose autocorrelation 
function has the form 


K()- o* (1 +a) t|)exp(—a|t]) 


8. A stationary random process has 
a power spectrum represented by the 


following plot: 





this 
differentiable, and find the variance of its 
derivative. 

9. The quasi-frequency of a random 


Prove that random process is 


process of variance 8 V? is 0.5 MHz. 
Determine the variance of its derivative. 

10. A stationary random process X (t) has 
the power spectrum 


Fo] 


The realizations of the process are defined 
by 


x (t)= A(t)cos ost — B(t)sin Wot 


Fy for œ <0 «0, 
0 for o «0,, 070; 


where 
© = (0; — ©, )/2 


Find its autocorrelation functions K 4(t) and 
Kpg(t) and its cross-correlation function 
Kas(t). 

11. Find the mean and the variance of the 
envelope of a narrowband normal random 
process for which the autocorrelation 
function is 


Ky, (x) = 25exp( — 4 x 10°t?)cos10°t 


12. A 
process 


normal random 
the autocorrelation 


narrowband 
X(t) has 


218 


function 
Kx (1) = o?exp( — Bt?/2)cosm t 
Find the autocorrelation function and the 


power spectrum for the envelope of the 
process. 


Advanced Problems 


13. Analyse the autocorrelation function 
of a process recognized as a random 
telegraph signal. Its realizations are 
discontinuous functions which equiprobably 
take on only two values: +a and —a: 


+a 


-a 


Part One. Signals 


At random instants of time, each realization 
changes its sign abruptly. The probability 
that over a time T the sign will be changed 
n times obeys the Poisson law: 


n 





Pr(n)- exp( — AT) 


n! 


where À is the parameter defining the time 
rate of change of the process. 


14. A narrowband normal random 
process X(t) has the autocorrelation 
function 


Kx (t) = o2 p(t)cosmot 


Prove that the square of its envelope has the 
autocorrelation function 


Kuz (t) = 40%p? (1) 


15. A narrowband normal random 
process has the autocorrelation function 
defined in Problem 14. Find the univariate 
probability density for the instantaneous fre- 
quency of the process. 


Circuits 


Chapter 8 


Response of Linear Stationary 
Systems to Deterministic Signals 


Part One of this book has dealt with the basics of signal theory. 
It has been stressed that signals can be the objects of a theoretical 
study only after we introduce suitable mathematical models. This is 
also true of the structures used to process, transform or transmit 
signals. These structures are extremely diverse in both their internal 
arrangement and in their external characteristics. So that they can 
be compared and classified, we should above all formulate 
a number of basic notions. 


8.1 Physical Systems 
and Their Mathematical Models 


However different communication circuits may be, each will 
always have an input to receive the original signals, and an output 
to deliver the transformed signals for further use. As a rule, this is 
illustrated by a block diagram of the “black box” type. 

System operators. In the simplest case, both the input signal 
uin (t) and the output signal uoyt(t), frequently called the response of 
a system, are individual functions of time. In the more general case, 
the input signal is represented as an m-dimensional or vector 
variable 


Uia (t) = (tini (t), Uin,2 (f sss Yin (t)] 


and the output signal as an n-dimensional or vector variable: 


Uour(t) = {Yout,1 (t), Uout,2 (t), tees Uout,n(t)} 


The relation between Uj, and Ü,, can be specified by means of 
a system operator T whose action on Ui, results in Ug 


Dour (t) = TU, (tO) (8.1) 





& 
A system operator 
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Example 8.1. Suppose that a system transforms a one-dimensional 


signal such that 


Uout(t) = 15 duin (2)/dt 


In this case the system operator may be written as 


T s 15d/dt 


Yin 
5 


- 


d/dt 
From the above expression we can identify the system as consisting [e] 


of a scaler (an ideal amplifier) and a differentiator, as shown in the ! 
accompanying block diagram. Hout 








* 
A mathematical model 
of a physical system 


To make the problem completely defined, it is also necessary to 
specify the domain Din in some functional (for example, Hilbert) 
space, which is called the domain of eligible input signals. In the 
simplest case it is specified by stating the kind of eligible input 
signals which may be continuous or discrete, deterministic or 
random. Similarly we define the domain of eligible output signals, 
Dout. 

The combination of an applicable system operator Tand the two 
eligible signal domains, Din and Douw, will be further referred as 
a mathematical model of the physical system involved, and 
communication systems will be classed on the basis of the most 
significant properties of their mathematical models. 

More specifically, this Chapter will be solely concerned with 
systems acted upon by analog signals defined by both continuous 
and discontinuous functions of time. The transformation of discrete 
(and, especially, digital) signals by linear systems will be examined 
in Chap. 15. 

Stationary and nonstationary systems. A system 1s said to be 
stationary, if its response is independent of the time at which it 
accepts the input signal. If Tis the operator of a stationary system, 
then from the equality 


Ü out(t) = TU in(t) (8.2) 
it follows that 
Ü out sb to) = TU in(t E to) (8.3) 


for any value of ty. Also, systems are called stationary if their 
parameters remain constant in time, or time-invariant. 

Otherwise a system is called nonstationary (a time-variant or 
parametric system). 

The two classes of systems are widely used in telecommunications 
and will be the subject of the subsequent discussion. It should be 
pointed out, however, that a theoretical study of nonstationary 
systems is ordinarily a far more complicated task. 
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Linear and nonlinear systems. A most important principle 
underlying the classification of communication systems is that 
various systems generally respond differently to a sum of input 
signals. If the system operator is such that 


TiU S t Üin.;)— TL + Ties 





T(xD,) -aTÜ 64 a 
The principle of 
. : . superposition 
where « is an arbitrary number, then the system is linear. The 
conditions in (8.4) define the fundamental superposition principle. 
rl in Example 8.2. A system transforms the input signal in such a way 
that 


d 
Uout(t) = (5 + a) Uin(t) 


pa It can be verified by inspection that the conditions defined in (8.4) 
are satisfied. Thus, the system in question is linear. 


Example 8.3. Suppose that a system is an ideal squarer operating in 


accordance with the algorithm 


Uout(t) = u(t) 
U out 


By applying a sum of two input signals, uin, ; + Uin,2, we obtain the 


following response: 


Uout(t) = Mis + 2uin, 1Hin,2 + Win, 2 


The presence of the cross-product 2uin,,Win.. is an indication that 


the system is nonlinear. 


Strictly speaking, all physical systems dealt with in 
telecommunications are to a varying degree nonlinear. However, 
there is a class of systems for which linear models yield a fairly 
accurate description. For example, we can practically always ignore 
the nonlinear behaviour of ordinary resistors, capacitors and some 
inductors. As will be shown later, linear systems are remarkable in 
that for them we can, at least theoretically, solve any problem 
involving the transformation of an input signal. 

Nonlinear circuits usually contain diodes and transistors. Their 
nonlinearity manifests itself in that their current-voltage 
characteristics strongly differ from linear relations. 

Although the theory of nonlinear systems is, as a rule, very 
complicated, and far from any results can be deduced analytically, 
it is with the aid of nonlinear elements that the most important 
transformations are performed on communication signals. A theory 
of the simplest nonlinear systems is set forth in Chap. 11. 
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ICs are examples of 
lumped-constant sys- 
tems 





A waveguide is an 
example of a distribu- 
ted-constant system 
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Lumped-constant and distributed-constant systems. Another 
principle for classifying the elements, devices and systems used in 
telecommunications is by comparing the physical size of a system 
with the wavelength applied to its input. If the characteristic 
dimension of a system (say, the maximum length of the wires in an 
electric circuit) is substantially smaller than the wavelength used, we 
have a lumped-constant system. 

In a lumped-constant electric circuit, it is always possible to 
single out physical regions within which the energy of the electric 
field, as in capacitors, or the energy of a magnetic field, as in 
inductors, is concentrated (or lumped). The properties of 
lumped-constant circuits are independent of the configuration of 
connecting wires, therefore it is customary to describe such circuits 
by use of their abstract models called schematic circuit diagrams. 

In telecommunications, lumped-constant circuits are used at fre- 
quencies up to several hundred megahertz. Their analysis and 
synthesis are carried out by invoking the Kirchhoff laws. 

At microwave frequencies, the physical size of most devices is 
comparable with the wavelength used. Because of this, it is essential 
to consider the effect of the finite time it takes a signal to propagate 
around the system. Ordinary electric circuits cannot be used at 
microwave frequencies, and they give way to what are called 
distributed-constant systems (also known as waveguide systems). 
Instead of connecting wires, use is made of lengths of metal tubes, 
called waveguides, and instead of IC tuned circuits resort is made 
to their distributed-constant counterparts known as cavity 
resonators or resonant cavities. As a rule, the theory, analysis and 
synthesis of distributed-constant systems are fairly complex and are 
the subject-matter of separate disciplines. 

To conclude our brief overview of system classification, we shall 
concentrate on lumped-constant linear stationary systems—the 
simplest type of all. The most typical examples are linear electric 
circuits whose properties must be known to the student from the 
previous courses. To them we may add, however, any linear 
physical devices and systems whose properties remain inchanged in 
time and whose size is small as compared with the wavelength used. 


8.2 The Impulse, Step 
and Frequency Responses of Linear Stationary Systems 


Linear systems have a remarkable property-they obey the 
superposition principle. This offers a direct approach to 
a systematic analysis of system responses to a variety of input 
signals, also called driving or forcing functions, or excitations. Using 
the dynamic representation of signals set forth in Chap. 1, we can 
resolve input signals into sums of elementary pulses. If, now, we 
find, in one way or another, the response of a system to any 
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elementary excitations, the final step in solving the problem will be 
simply to combine the individual responses. 

This form of analysis is based on the representation of signal and 
system properties in the time domain. It is equally possible and, 
sometimes, even more convenient to use their analysis in the fre- 
quency domain when signals are specified by giving their Fourier 
series expansion or integrals. Then the system properties can be 
represented by their frequency characteristics which define how the 
elementary harmonic signals are transformed. 

The impulse response. As will be recalled, the dynamic 
representation of signals uses any one of two elementary 
excitations. These are the unit step input and the unit impulse input 
or delta function. Let us first turn to the integral representation of 
a signal by means of the delta funcion. 

Let a linear stationary system be described by its operator T. For 
simplicity we assume that the input and output signals are 
one-dimensional. By definition, the impulse response of a system is 
the function h(t) which is the system response to a forcing function 
of the form ó$(t) This implies that h(t) satisfies the following 
equation: 


h(t) = T8(t) (8.5) 


Since the system is stationary, a similar equation will hold when 
the input excitation is translated in time through an arbitrary 
interval to: 


h(t — tg) = T9(t — to) (8.6) 


It must be clearly realized that the impulse response as well as 
the forcing delta-function are outcomes of a reasonable idealization. 
From a physical point of view, the impulse response approximates 
the response of a system to a unit-area impulse forcing function of 
an arbitrary waveform, provided that the duration of the input 
signal is negligible in comparison with the system’s transient time, 
that is, the time it takes for the system to reach a steady state. 

The Duhamel superposition integral. An extremely important 
role that the impulse response plays in the theory of linear 
stationary systems stems from the fact that knowledge of h(t) 
enables us to solve formally any problem concerned with the 
passage of a deterministic signal through such a system. Indeed, as 
has been demonstrated in Chap. 1, the input signal can always be 
represented as 


Uin(t)= f uin(t)8(t— t)dt 


In mathematics, the 
impulse response is 
known as the Green 
function of the opera- 
tor in question 


B 

The physical signifi- 
cance of the impulse 
response 
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The respective response is then 


Uout(t) = Tui(t) T f uin(t)8(t — t)dt (8.7) 


Now we recall that an integral is the limit of a sum, so the linear 
operator T may, on the basis of the superposition principle, be 
included under the integral. Also, the operator T “operates” only on 
the terms dependent on the current time t, but not on the 
integration variable t. Therefore, from Eq. (8.7) it follows that 

oO 


uow(t) - f uin(t) Tó(t — x) d: 


or, finally 


Uout(t) = f ui (1) h(t — t)dt (8.8) 


The result in Eq. (8.8), of fundamental significance in the theory of 
linear systems, is called the Duhamel superposition integral. From 
inspection of Eq. (8.8) it is seen that the output signal from a linear 
stationary system is the convolution of two functions- the input 
signal (excitation) and the impulse response. Obviously, we may 
re-write Eq. (8.8) as 

oo 


Uout(t)= f uin(t — t)h(t)dt (8.9) 


A major advantage of the analysis based on the Duhamel 
superposition integral is that, once the impulse response h(t) is 
found, we can reduce the subsequent computational steps to 
completely formalized operations. Even if the integrals in (8.8) and 
(8.9) cannot be found analytically, it is always possible to analyse 
them numerically on a computer. 








Example 8.4. Suppose that a linear stationary system, whose di h 
0 


internal arrangement is immaterial, has an impulse response which is 
a rectangular video pulse of finite duration T and of amplitude Ag, 
occurring at t =Q: 


i t<0 
h(th=< Ay, O<t<T 


0, t>T 


Find the response of the system, if the excitation is the step input (to 


e 
- 
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be defined later): 
Uin(t) = Ug a(t) 
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In using the Duhamel superposition integral in (8.8), we note that 
the output signal varies according as the time t exceeds or not the 
duration of the impulse response. For 0<t< T; we have 


Uout(t) = AQU, | dt = Ao U ot 
0 


Mout On the other hand, if t> T, then for t> T the impulse function 






EX h(t —1) vanishes, and so 


T 
SUCH. GED 
Cod oat uout(t) = AoU o f dt = AgU oT 
POLETU, > 
bal vin 
0 T The response thus found is plotted as a piecewise-linear function. 





Generalization to the multidimensional (vector) case. It has been 
assumed that both the forcing function (excitation) and the output 
signal (response) are one-dimensional In the more general case of 
a system with m inputs and n outputs, we need to introduce the 
partial impulse responses hjj(t) (i= 1, 2, ..., n; j= 1, 2, ..., m), each 
of which represents the response at the ith output to the delta- 
function excitation which is applied to the jth input. The set of 
functions Aj(t) forms the impulse-response matrix 


IM see ee 
h= 2 :::: (8.10) 
hm An ... ham 


In the multidimensional (vector) case, the Duhamel superposition 
integral takes the form 


Uout(t) = f h(t — t)Uin(t)dt (8.11) 


where Uj is an m-dimensional vector, and U oy; is an n-dimensional 
vector. 

The condition for physical realizability. Whatever the actual form 
of the impulse response of a physically realizable system, the 
following important principle must always be satisfied: A physical 
system cannot give an output in advance of the input signal. 

This principle imposes a very simple constraint on the form of 
feasible impulse responses: 


h(t) 20 for <0 (8.12) 


~ 


~ 


Examples of impulse 


responses for 
izable systems 


real- 
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This condition is met, for example, by the impulse response of the 
system considered in Example 8.4. 

It is easy to see that for a physically realizable system the upper 
limit in the Duhamel superposition integral must be replaced with 
the current value of time: 





Uout(t)= J uin(t)h(t—1)dt (8.13) 


Equation (8.11) has a clear physical significance: A linear 
stationary system performs the operation of weighted summation 
over all instantaneous excitation values applied to the input and 
existing in the “past” for — oo «1 « t. The weighting function here 
is the impulse response of the system. Importantly under no 
circumstances can a physically realizable system operate on the 
information embodied in the "future" values of the input. 

The step response. Let the forcing function (excitation) acting at 
the input of a linear stationary system be a unit step input 
represented by the Heaviside unit function c (t). The response of the 
system to this form of excitation 


g(t) = To (t) (8.14) 


is called the step response of the system. Because the system in 
question is stationary, the step response is invariant under the time 
translation: 


g(t — to) = To(t — to) 


What has earlier been said about the realizability of a system 
fully applies to a system driven by a unit step input as well as by 
a unit impulse. Therefore, the step response of a realizable system 1s 
nonzero only for t — 0, whereas 


g(t) - 0 for t<0 (8.15) 


There is a close relation between the impulse response and the 
step response. To demonstrate, since 6 (t) = do/dt, then, by virtue of 
(8.5), 


d 
h(t)= r|] 


The differentiation operator d/dt and the linear stationary operator 
T may be interchanged, so 





h(t) =| To ( = 4 (8.16) 
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or 
t 
g(t)= J h(&)d& (8.17) 
Example 8.5. Find the step response of the linear system from 
Example 8.4. 
Since here 


h(t) = Ago (t) — Ago(t — T) 
then, on the basis of Eq. (8.17), 


0 for t<0 
g(t)=< At for Oct«T 
ÁT for t» T 


Thus, the system being at rest at t «0 will change to a new 
stationary state in response to a unit step input during the time 
equal to the duration of the impulse response. 





Taking advantage of Eq. (1.4) used in the dynamic representation 
of signals and proceeding along the same lines as in deriving 
Eq. (8.8), we obtain one more form for the Duhamel superposition 
integral: 

t 


Uout(t) = uin (0) g (t) + J (duin/dt) g(t — t)dt (8.18) 
0 


The frequency response. In mathematical analysis of systems, it is 
important to find such input signals (excitations) which, on being 
operated upon by a system, remain unchanged to within a certain 
numerical factor. If the equality 


Uout(t) = Tuin(t) = Auig(t) (8.19) 


is satisfied, then uin(t) is called the eigenfunction of the operator T. 
and the number à (complex in the general case) is called its 
eigenvalue. 

Let us show that the complex signal uin(t) = exp (jot) is the eigen- 
function of a linear stationary system for any œ. To this end, we 
take advantage of the Duhamel superposition integral as defined in 
(8.9) and obtain 


Uout(f) = f exp [jo (t — t)] h(t) dt 


=[ f h(t) exp( — jot) dt] exp (jot) (8.20) 


9 
Eigenfunction 
eigenvalue 


and 
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The frequency  re- 
sponse of a system 


E 

Analysis in the time 
domain and the fre- 
quency domain 
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Hence, the eigenvalue is the complex number 


K (jo) — j h(t)exp(— jot) dt (8.21) 





called the frequency response of a system*. 

Equation (8.31) establishes a fundamental fact: The frequency 
response and the impulse response of a linear stationary system are 
related by a Fourier transform pair. Therefore, if we know K (jo), we 
can always determine the impulse response of the system 





x 


h(t) - x | K (jo) exp Gat) do (8.22) 


= 00 


This has led us to a crucial point in the theory we are concerned 
with: Any linear stationary system may be analysed either in the 
time domain by use of its impulse and step responses, or in the fre- 
quency domain on the basis of its frequency response. Each is as 
good as the other one, and the choice is a matter of convenience in 
obtaining initial specifications and calculations. 

In conclusion, it should be noted that the frequency properties of 
a linear system having m inputs and n outputs can be described by 
the frequency response matrix 


Kia Kh give, Kin 
K@Gm= |: : : : 1:1: (8.23) 


Kn, Kna e. Kum | 


The relation between the matrices h and K is similar to that defined 
by Eqs. (8.21) and (8.22). 

The amplitude (or magnitude) response and the phase response. 
The frequency response K(jo) is simple to interpret: If the 





* The alternative terms are the complex response or the complex transfer 
function (J. Brown and E.V.D. Glazier, Telecommunications. London: 
Chapman and Hall, 1974), the system or response function [20], the transfer 
response (Handbook of Automation, Computation and Control. Ed. Eu. 
M. Grabbe, S. Ramo, and D.E. Wooldridge. New York: John Wiley and 
Sons, Inc., 1958), etc.- Translator's note. 
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excitation is a harmonic signal of known frequency and of 
complex amplitude Uin, then the complex amplitude of the output 
signal will be 


U sai =K (jo) Ui (8.24) 


Frequently, especially in engineering calculations, the frequency 
response is written in the exponential form: 


K (jo) = | K (jo)| exp jx (o) (8.25) 


The two real functions involved have each a special name. Thus, 
| K (jo)| is called the amplitude (or magnitude) response, and @x(@) is 
called the phase response of the system. There is a variety of 
instruments designed to measure and record the two functions of 
various electric and electronic circuits and devices in any frequency 
range. 

The constraints imposed on the frequency response. Not just any 
function K(jo) may be the frequency response of a realizable 
system. The simplest constraint arises because the impulse response 
h(t) must be real. By virtue of the properties of Fourier transforms 
(see Chap. 2) this means that 


K (jo) = K*( — jo) (8.26) e 


As follows from Eq. (8.26), the modulus of the frequency response The properties of the 
(or the amplitude response) is an even function of frequency, amplitude and phase 
whereas the phase angle (that is, the phase response) is an odd response 
function of frequency. 

It 1s far more difficult to say what the frequency response must 
be like for the realizability condition, (8.12) or (8.15), to be satisfied. 
The answer is given by the Paley-Wiener criterion which we will 
give without proof The Paley-Wiener criterion states that The Paley-Wiener cri- 
a necessary and sufficient condition for an amplitude response to be terion 
realizable is that 


ac 





| |log| K (jo)1 | 


Drap dex to (8.27) 


Let us consider a specific example which illustrates the relation 
between K(jo) and h(t). 


Example 8.6. Suppose that a linear stationary system behaves like 
an ideal low-pass filter. This implies that its frequency response is 
specified by the following set of equalities: 


0, o «€ — Olim 
K (jo) =4 Ko, — Olim < O € Olim 


0, © > Olim 
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On the basis of Eq. (8.20), the impulse response of such a filter 
IS 


Olim 


K 
h(t) = —2- | exp (jat) da = 
2n 


—@lim 


The symmetry of the function about t = 0 is an indication that an 
ideal low-pass filter is not physically realizable. In fact, the same 
conclusion could be drawn directly on the basis of the 
Paley-Wiener criterion. This is because the integral in (8.27) turns 
out to be divergent for any system whose amplitude re- 
sponse function vanishes within some finite interval on the 
frequency axis. 

Although an ideal low-pass filter is not physically realizable, this 
model is successfully used to approximately describe the properties 
of filters, assuming that the function K (jo) contains a phase factor 
which is a linear function of frequency: 


KoOl]im Sin Olimt 
oO1im lim! (8.28) 
T Olim t 


0, 0< — Olim 

K(jo)-4 K exp(— joto),  — Olim < € < Olim 
\ 0, © > Olim 

As can be readily verified, here 

olim Sin Otim (t — tg) 

n him (t — to) 

The parameter tọ, equal to the slope of the phase response, defines 

the time delay for the time shift of the maximum of h(t). Obviously, 


the accuracy with which this model can represent the properties of 
a realizable system improves as tọ increases in value. 


(8.29) 





K 
h(t)= 


8.3 Linear Dynamic Systems 








Amplitude response 
/ 


The heading refers to linear systems which have the following 


property: the output signal is determined not only by the value of 
the input signal at any particular instant of time at present, but also 
by the entire “past history” of the input process. In other words, 
a linear dynamic system has “memory” which governs the manner 
in which the input signal is transformed. 

Systems described by differential equations. Of the many possible 
dynamic systems, those of primary concern to communication 
theory are systems which can be described by differential equations. 
In the most general case, these are systems for which the input-out- 
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put relations are established by the following differential equation: 





d'ugut d" tuont duout 
oa On-1 c qgpei T "TT 1 dt + dgMout 
(8.30) 
dy; d" !y; dui 
= bin T + D 1 P dus b, a + botin 


Precisely this form of dynamic relation exists between the 
instantaneous values of the input and output signals in 
a lumped-constant electric circuit. If the circuit is linear and 
stationary, then all coefficients ao, a,, ..., a; and bo, by, ..., b, are 
constant real numbers. 

Suppose that the input signal uis (t) is fixed. Then the right-hand 
side of Eq. (8.30) which can arbitrarily be designated as f(t), is 
a known function. Then the analysis of the system's behaviour 
reduces to the well-known mathematical problem of solving an 
nth-order linear differential equation with constant coefficients: 


d"uout d" !uout 
an i F a a +... Ag Uout —f(t) (8.31) 


The order n of the equation is called the order of the dynamic 
system involved. 


Consider several examples of dynamic systems and the 
corresponding differential equations. 


e 
The order of a dyna- 
mic system 


` Example 8.7. Consider an RC-network in the form of an L-section 


va C | vou two-port driven by a source of emf, vin(t). The output signal is the 
s | voltage across the capacitor. 
d g Since the current in the circuit is 


First-order systems are 
also called pure-delay 
(or lag) elements 


i(t) = C dvout/dt 


equation 


RC dvout/dt + Vout = Vin (t) 


then, using the Kirchhoff voltage law, we obtain the differential 


(8.32) 


Thus, an RC-network is an example of a first-order dynamic 
system. The most important parameter of the circuit is the time 
constant, t= RC, which defines the time scale for the process 


occurring in the system. 


Example 8.8. Let there be a more complex system formed by two 
RC-networks decoupled by an ideal amplifier of gain Ko. It is 
presumed that the input impedance of the amplifier is infinitely high, 
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and its output impedance is infinitesimal so the amplifier is an ideal 
decoupling element between circuits. 






C2 





T | vous 


On introducing two time constants, 1, = R,C, and t; = R5;C;, 
we obtain by analogy with the previous example the following 
Ist-order differential equations 


T2 dvout/dt + Vout = Kot, 





T; dv, /dt + v, = vin (t) 


Eliminating the dummy variable v, between them, we obtain the 
differential equation 


14 9d? vout/dt? + (1, + 15) dvout/dt + Vout = Kotin (t) (8.33) 
Now, we have a more complex RC-network which is a 2nd-order 
system. 


Example 8.9. Develop the differential equation that describes the 
behaviour of a lossy parallel resonant circuit: 


i= 





Here the excitation is a current i(t), and the response is the voltage 
v(t) across the resonant circuit. 
On combining the currents 


t 
l 
ic = C dv/dt, im | dt ig — v/R 


we obtain the equation 
$ 


l 
C dv/dt + — f v dE + v/R = i(t) 


Hence, 
d?v/dt? + 2a dv/dt + ov = (1/C) di/dt (8.34) 
where @) = U/V LC is the natural frequency of a loss-free resonant 


circuit, and œ = 1/2RC is the attenuation constant of the resonant 
circuit. 


A 
Solve Problem 4 
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The free (transient) response of dynamic systems. A complete 
analysis of the behaviour of a dynamic system described by 
Eq. (8.30) or Eq. (8.31) requires that we should take into account 
the initial conditions characterizing the mternal state of the system 
at some fixed instant of time. It is usual to specify the values of the 
sought response function and of its n—1 derivatives for t=0: 
uout (0), ..., ubut D (0). 

From the theory of differential equations [8], it is known that the 
total solution of Eq. (8.31), satisfying any initial conditions, is the 
sum of a particular integral which is a particular solution of 
a nonhomogeneous equation (that is, one whose right-hand side is 
nonzero) and the complementary function which is the general 
solution of the homogeneous equation 


n x 
d'uout d" tout 


an ;;H T Un-1 dt^ 1 


+... + GgUout = 0 (8.35) 
at 


The solving of the homogeneous equation involves finding the 
roots of the characteristic equation of the system 


any” + ay y" b+... +d) =0 (8.36) 


The characteristic equation has exactly n roots and, since the 
coefficients of the characteristic equation are real, the roots y,, Y2, 
..., Yn May be real or complex conjugate. If all roots are distinct, 
the complementary function, which represents the free (transient) 
response of (free oscillations in) the system, has the form 


Ufree (t) = C, exp (y,t) + C exp (y5t) + ... + Cn exp (yat) (8.37) 


where C,, C,, ..., C, are constant numbers defined from the initial 
conditions. If some roots of the characteristic equation are repeated 
(multiple roots) the form of the complementary function is 
somewhat complicated owing to the appearance of the so-called 
secular factors. Then to each real root of multiplicity k we assign 
a set of free (transient) response functions of the form 


exp(yit) — texp(yit, -n #7! exp (yt) 


Consider a few examples of the free (transient) response of (free 
oscillations in) linear stationary circuits. 


m 

The property of the 
roots of the characte- 
ristic equation 


This term has come 
over from astronomy 





Example 8.10. An aperiodic discharge of a capacitor. A capacitor 


t=0 of capacitance C, charged to a voltage Vo, is allowed to discharge into 
a resistor R by closing the circuit at time t — 0. Find the manner in 
+ which the voltage across the capacitor varies. 
ki C R The system can be described by the differential equation 
t dvc/dt 4- vc — 0 
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and its output impedance is infinitesimal so the amplifier is an ideal 
decoupling element between circuits. 





On introducing two time constants, t; = R,C, and t; = R;C;, 
we obtain by analogy with the previous example the following 
Ist-order differential equations 


15 dvout/dt + Vout = Kot, 
T, dv, /dt + v, = vin (t) 


Eliminating the dummy variable v, between them, we obtain the 
differential equation 


1, 15d? vour/dt? + (1, + T2) dvout/dt + Vout = Kovin (t) (8.33) 
Now, we have a more complex RC-network which is a 2nd-order 
system. 


Example 8.9. Develop the differential equation that describes the 
behaviour of a lossy parallel resonant circuit: 


i()- 





Here the excitation is a current i(t), and the response is the voltage 
v(t) across the resonant circuit. 
On combining the currents 


we obtain the equation 
t 
1 
C dv/dt + I | vdg+v/R=i(t) 


Hence, 
d*v/dt? + 2a dv/dt + w2v = (1/C) di/dt (8.34) 
where @) = 1 [VLC is the natural frequency of a loss-free resonant 


circuit, and «= 1/2RC is the attenuation constant of the resonant 
circuit. 


A 
Solve Problem 4 
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The free (transient) response of dynamic systems. A complete 
analysis of the behaviour of a dynamic system described by 
Eq. (8.30) or Eq. (8.31) requires that we should take into account 
the initial conditions characterizing the internal state of the system 
at some fixed instant of time. It is usual to specify the values of the 
sought response function and of its n—1 derivatives for t=0: 
Uout (0), ..., ubut » (0). 

From the theory of differential equations [8], it is known that the 
total solution of Eq. (8.31), satisfying any initial conditions, is the 
sum of a particular integral which is a particular solution of 
a nonhomogeneous equation (that is, one whose right-hand side is 
nonzero), and the complementary function which is the general 
solution of the homogeneous equation 


d"ugut du d" Hout 
dt” nat dr’ 1 


The solving of the homogeneous equation involves finding the 
roots of the characteristic equation of the system 


an +... + Aguout = 0 (8.35) 


Any" ay Y" 1 +... ag =0 (8.36) 


The characteristic equation has exactly n roots and, since the 
coefficients of the characteristic equation are real, the roots y,, Y2, 
..., Yn May be real or complex conjugate. If all roots are distinct, 
the complementary function, which represents the free (transient) 
response of (free oscillations in) the system, has the form 


Ufree (t) = C, exp (yt) + C; exp (y2t) +... + Cn exp (Ynt) (8.37) 


where C,, C,, ..., C, are constant numbers defined from the initial 
conditions. If some roots of the characteristic equation are repeated 
(multiple roots) the form of the complementary function is 
somewhat complicated owing to the appearance of the so-called 
secular factors. Then to each real root of multiplicity k we assign 
a set of free (transient) response functions of the form 


exp(yit), — texp(vit) ... "exp (yt) 


Consider a few examples of the free (transient) response of (free 
oscillations in) linear stationary circuits. 





[ | 

The property of the 
roots of the characte- 
ristic equation 


This term has come 
over from astronomy 





Example 8.10. An aperiodic discharge of a capacitor. A capacitor 
t-0 of capacitance C, charged to a voltage V}, is allowed to discharge into 


a resistor R by closing the circuit at time t — 0. Find the manner in 
$ which the voltage across the capacitor varies. 
Vo =C R 


tdvc/dt+vc=0 


The system can be described by the differential equation 
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subject to the initial condition 
vc(0) — V, 

The characteristic equation 

ty 1120 

has one root 

y= —l1ft 


The complementary function (the transient solution) can be written 
as 


vc(t) = A exp ( — t/t) 


In order to satisfy the initial condition, we should set A = V,. So, 
finally, 

vc (t) = Vo exp( — t/t) 

This result defines the physical significance of the time constant t as 
the time interval during which the free (transient) response decays 
to 1/e of its original value (here, e = 2.71828...). 

To sum up, the negative real root of the characteristic equation 
corresponds to a free (transient) response exponentially decaying 
with time. 

Example 8.11. An oscillatory discharge of a capacitor. The circuit 
of the previous example is expanded to include an inductor L. 

On the basis of the Kirchhoff second law, the differential 
equation of the circuit in terms of the current i(t) has the form 
d?i/dt? + 2a di/dt + oži = 0 (8.38) 
where a= R/2L and o9 —1 Mc. 

The obvious initial condition i(0)=0 stems from the presence of 
an inductor in the circuit - the current through an inductor cannot 
change jumpwise. There is one more condition: At the initial 
instant of time the voltage across the capacitor is balanced by an 
emf of seif-induction: 


Vo + Ldi/dt | t-o =0 

Hence, 

di/dt| t-o = — W/L 

The characteristic equation 

y? + 2y +o =0 

has complex conjugate roots 

Y= —&ijl/ed—o?— —a t jor 


where or is the frequency of the free response of (free oscillations in) 
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the system. As a rule, one is interested in the free response of 
a low-loss circuit, when @)>a, SO Or x Gg. 


The complementary function 


i(t) = C, exp (y,t) + Cz exp (72!) 


(8.39) 


should contain the coefficients C, and C, satisfying the following 
set of algebraic equations (see the initial conditions): 


C,+C,=0 
W101 + Y2C2 = — W/L 


Hence, 
Cy = — W/2jexL, C; = Vo/2jork 





i(t)= — (V /ofL) exp ( — at) sin crt 


The frequency response. If the excitation applied to a linear 
dynamic system is an exponential signal of the form üin(t) = 
— exp(jot) then its response will be 
Uout(t) = K (jo) exp (jot) 


On substituting these expressions in (8.30) and cancelling out the 
common factor, we obtain the frequency response of the system 


bm Go)” + by. , Ga)" ! +... +b; (jo) + bg 


K (jw) = 
Vo) An (j@)" + a.., GO)" +... + a, (je) + ay 





(8.41) 


Thus, the frequency response of any dynamic system described by 
ordinary differential equations with constant coefficients is 
a rational function of jo. The coefficients of this function are the 
same as the coefficients of the differential equation. 

In practice, the frequency response of a linear system is usually 
found by inspection of the applicable circuit diagram, using the 
techniques of circuit theory, without writing differential equations. 


On substituting them in (8.39), we finally get 


(8.40) 


The frequency  re- 
sponse of a distributed 
system is free from 
this constraint and may 
be described by more 
complex functions 


Example 8.12. For the RC-network of Example 8.7 


. 1/jaC . 
K (jo) = 9" = 
(o) = Rifoc ^ te) 


where x — RC is the time constant. 


(8.42) 


The equation for the amplitude response takes the form 


| K (jo)| = 1//1 + o?c 
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and that for the phase response IKI 
1.0 Amplitude response 


@x(®)= — arc tan (ox) 


From the form of the amplitude response it is seen that the 
circuit in question may be used as a low-pass filter. 

Example 8.13. Analyse the frequency response of an L-section Phase response 
two-port consisting of an L, a C, and an R: 





i 2 pes 
g—4 1]—^"^ 
R L | Px 

|" "T fru 

ee er 
Here, 

Li 

K (jo) — Moe ! 





R+joL+ljoC  (1—o?LC)-4- joRC 

Hence, the equation for the amplitude response is 
1 

V — o? LC? + o? R? C? 


and that for the phase response is IY response 
oRC 


| 
1—@7LC N 
w 


| 
If the loss resistance R is sufficiently small, so that the system 9 1/VEC 
Q-factor is Q = |/ L/C/R > 1, this circuit may successfully be used as A 


a band-pass filter. Solve Problem 5 


IKI 













| K ()| = 
f Amplitude 





@x(@®)= — arctan 








An aperiodically loaded small-signal amplifier. An important 
example of linear dynamic systems is the electronic single-stage 
voltage amplifier shown in Fig. 8.1. 

Here to make the matters more definite, the controlled electronic 
element is an N-P-N bipolar transistor. This may as well be FET (a 
field-effect transistor) or an electron tube. 

So that any such circuits can be analysed in a unified fashion, it 
is customary to draw up their equivalent circuits. The equivalent- 
circuit method is applicable when the amplitudes of the alternating 
voltages around the circuit are so small that the nonlinearity of the 
external (load) characteristics of the devices may be neglected. For 
example, a bipolar transistor can be represented with sufficient 
accuracy by a linear equivalent circuit, if the amplitude of the a.c. 
component of the input voltage is small in comparison with what is 
known as the thermal potential of the P-N junction: 


vr=kT/e 
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Fig. 8.1 Single-stage voltage amplifier: (a) simplified schematic diagram; (b) 
equivalent circuit; Rg, load resistor; C,, stray capacitance 


where k is the Boltzmann constant, T is the absolute temperature of 
the junction, and e is the charge on an electron. 

It is shown in circuit theory that the simplest equivalent circuit 
for the output of an active electron device (see Fig. 8.15) contains 
a controlled current source producing a current — gmvin (where gm 
is the transconductance of the device at the Q-(quiescent) point), 
and the output (internal) resistance of the device, Rj, connected in 
parallel with the current source. 

The amplifier’s load is a parallel combination of a load resistor 
Ry and a stray capacitance Cs. This type of load is known as 
aperiodic in contrast to an oscillatory load such as an LC-network. 

The overall admittance connected in parallel with the current 
source is 


Ys = 1/Ri + 1/Ri + joC; 


If the excitation applied to the amplifier is a harmonic signal at 
frequency o and of complex amplitude Vin. the complex amplitude 
of the output signal will be 


Vout = — gm Vin /Yz 


Hence, the frequency response of the circuit in question is 


K(jo)— —gm/Yz = — gm Reg /(1 + joC;Reg) (8.43) 


where Req = RLRi/(Rr + Ri). 

Thus, an RC-loaded single-stage voltage amplifier has the same 
frequency response as the RC-network examined earlier. At zero 
frequency, the amplitude response function is a maximum; the 
magnitude of the gain factor is Ky =QmReg. As the frequency is 
raised, the gain falls off due to the shunting effect of the stray 
capacitance. The bandwidth of an amplifier is customarily stated in 


The stray capacitance 
is the sum of the 
output capacitance of 
the electron device and 
that of the wiring 


At T= 300 K (stan- 
dard temperature) the 


thermal potential is 
25 mV 
The *—" sign is an 


indication that an in- 
crease in base voltage 
leads to a rise in 
collector current and 
a decrease in output 
voltage 
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The upper frequency terms of the upper frequency limit ©lim at which the value of the 
limit (or cutoff fre- amplitude response is 1/|/2, or 0.707 times its value at the centre 


quency) of an ampli- frequency*. As is seen from Eq. (8.43), since 
fier 


: gmR 
| K ((0)| = pm 
Vi + o^ RegC3 
then 


Olim = | / Req Cs 


Example 8.14. The amplifier is set up as shown in Fig. 8.1. Its 
parameters are: Rj, = 1.6 KQ, gy = 20 mAV !, C, = 30 pF, R;= 
= 15 kQ. Find the gain factor at zero frequency and the bandwidth of 


the system. 


To begin with, we find the equivalent load resistance: 


7 1.6 x 15 
1 X615 


= 1.45 KQ 


The magnitude of the gain factor at zero frequency is 
Ko =20 x 107? x 1.45 x 10? = 29 


The bandwidth of the amplifier is 


A 
Solve Problem 10 


lim = 1/(1.45 x 10° x 3x 107 14)=23 x 107 s7! 


fim = 3.66 MHz 





a 
Absolute stability of a 
system 


A fA t 


Oscillations in an un- 
stable system 


The stability of dynamic systems. By definition, a linear system is 
absolutely stable, if all of its natural oscillations are transients 
decaying with time. A necessary and sufficient condition for 
a dynamic system to be absolutely stable is that the real parts of all 
the roots of its characteristic equation, (8.36), are negative. A further 
condition is that the roots should not be purely imaginary. Al- 
though the free response of (transients in) the system would then be 
the sum of harmonic functions of the form 


sin 
Ufree (t) = (eot) 
cos 


even minute chance changes in the system parameters might drive it 
into an unstable state when 

sin 
Ufree (t) = exp (at) (Got), «>0 
cos 


* Otherwise, it is called the half-power bandwidth or the bandwidth 
between half-power points. Translator's note. 
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that is, the amplitude of the response would be building up 
exponentially with time. 

If the order of a dynamic system is sufficiently high, the direct 
check for stability based on the roots of the characteristic equation 
may prove very difficult to perform. To avoid this, special stability 
criteria have been developed. With them, the existence of positive 
real roots can be verified directly from the form of the coefficients 
with no need to solve the characteristic equation. These criteria will 
be taken up in Chap. 14. 

The transient response of an electric circuit can be exponentially 
rising only when in addition to the passive elements L, C and R it 
contains active elements which transfer some of the energy from 
external sources into the circuit. An example of active elements, 
known from circuit theory, is a negative-resistance resistor. 


239 


Example 8.15. A resonant circuit whose parameters are C = 80 pF, 


| R R neg 
T L 


————3— 2 


L = 2.5 uH and R = 12 Q contains a negative resistance connected in 
parallel with the inductive element. Find the critical value of the 
negative resistance at which the system turns unstable. 

As can be readily verified, the differential equation of the above 
circuit, written for the voltage v across the inductive element has 
the form 


(1 + R/Rneg)d?v/dt? + (R/L + 1/RnegC)dv/dt + v/LC — 0 (8.44) 
The roots y, and y, of the characteristic equation have real parts 
R/L + 1/RnegC 

2(1 + R/Rneg) 


The system will go into an unstable state if Rey, ; becomes zero. 
Hence, the critical value of the negative resistance is given by 


Rneg,cr = and L/RC = — 2.604 kQ 


Thus, the system in question will jump into oscillations 


Rey, 2= — 


spontaneously, if the negative resistance it contains is Rpeg > 


— 2.604 kQ. 


8.4 Spectral (Frequency-Domain) Analysis 


When speaking about spectral (frequency-domain) analysis as 
applied to the response of linear stationary systems, what is usually 
meant is a range of mathematical techniques based on the use of 
the properties of the frequency response. In the pages that follow, 
several examples will be examined in order to demonstrate the 
application of the spectral approach to directly finding and 
numerically evaluating the output signal of a system. 
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The basic equation. Let the excitation applied to the input of 
a linear stationary system be a deterministic signal uin (f) specified 
by its expansion into the Fourier integral: 


o0 


uis (t) == f So(oexpdondo (8.45) 


— ob 


Suppose that the mathematical model of the system is specified 
by its frequency response K (jo). As will be recalled, the complex 
signal exp (jot) is the eigenfunction of the system, giving rise to an 
elementary response K(jo)exp(jot) at the system's output. By 
combining the two signals, we obtain the spectral representation of 
the response: 


x 


a | K (jo) Sin (o) exp (jot) doo (8.46) 


Uout(t) = 
This is the basic equation of the spectral method. As is seen, the fre- 


quency response is a coefficient of proportionality between the spectra 
of the input and output signals 








Thus, a remarkable feature about system analysis in the fre- 
quency domain is that the effect of signal transformation in 
a system is represented simply by the algebraic operation of 
multiplication. 

It should be stressed that the frequency-domain (spectral) 
approach and the time-domain approach are each other's 
equivalents. Indeed, the Duhamel superposition integral (8.8) is the 
convolution of the function vin (tf) and the impulse response in the 
time domain: 


Uout (t) = uin (t) * h (t) 


In consequence, the spectrum of the output signal is the product of 
the spectra of the functions uin (t) and A(t). Equation (8.47) follows 
directly from this statement. 

The practical value of finding the response of a system by the 
spectral method depends in each particular case on whether the 
integral in (8.46) can be evaluated. 

Computation of the impulse response. As a rule, no fundamental 
difficulties arise in finding the frequency response of a linear system. 
Therefore, if it is required to find the impulse response h(t) of 
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a system, it is advantageous to use the spectral method by which 


hina | Kodex ando 
2n 


As an example, let us find the impulse response of an 
RC-network whose output signal is the voltage across the capacitor. 
Here 





1 
K (jo) = ———— 
(o) = C aR 
and so the impulse response is 
l exp (jot) d 
h(t)— Mum. (8.48) 
2n | + joRC 


Let us employ the residue method [11] and assume that œ is 
a complex variable. The integration contour in (8.48) is formed by 
the entire real axis Imc =0 and an arc C, of an infinitely large 
radius, which may close in both the upper and the lower half-plane. 
The integrand in (8.48) has a single simple pole at a point cp = 
=j/RC. The residue of the integrand at that point is C, 


| exp (jot) | 
es 
| 4- joRC 
Let us find h(t) for t > 0. To this end, the arc C, must be located 
in the upper half-plane, because it is only then that the function 
exp(jot) will tend exponentially to zero with increasing radius of 
the arc. In the limit, the contour integral will be equal to the 
integral taken solely along the real axis in accord with Eq. (8.48). 
By Cauchy's residue theorem, the contour integral of an analytic 
function is equal to 2nj multiplied by the sum of the residues of the 
integrand at all poles lying inside the contour of integration. Thus, 


= (1 jRC)exp( — t/RC) (8.49) _ \Rew 








0-0, 





h(t)li. o = (1/RC)exp( — t/RC) (8.50) 





If we want to find the impulse response for t < 0, the contour of 
integration must be closed in the lower half-plane where the 
integrand has no poles at all, and so 


h(t)|r«o =0 (8.51) 


Graphically, the impulse response of an RC-network constructed 
on the basis of Eqs (8.50) and (8.51) is a curve discontinuous at t= 
— 0 (Fig. 8.2). 

The representation of discontinuous functions by contour 
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integrals is a mathematical device widely used in a variety of 
theoretical studies. 

Computation of the output signal. As an example of using the 
spectral method, let us find the response of the RC-network defined 


earlier to the exponential video pulse 
Uin (t) = Ugexp( — at) o (t) 
Now the spectrum of the excitation is 
Sin (©) = Uo /(a + jo) 

h(t) RC 





—10—0.5 0 0.5 L0 1.5 2.0 2.5 3.0 
Fig. 8.2 Plot of the impulse response of an RC-network 


and the problem reduces to evaluating the integral 


x 





exp (jot) do 
t)=(U,/2na f 8.52 
uout (t) = (Uo/ | (1 + jo/a)(1 + joRC) ( ) 
On expanding the integrand into partial fractions, we get 


i ae E xRC Y 
(1 +jo/ay(l+joRC) 1—oRC\1+joja 1+joRC) 








Since the terms in the parentheses have the same structure, we may 
directly use the results obtained in finding the impulse response and 
write the solution as 


U, 
[uout (t) lt>0 = iie [exp( — at) — exp( — t/RC)] (8.53) 
Naturally, 
Uout (D | : «o = 0 (8.54) 


The applicable plot appears in Fig. 8.3. 

The frequency response of a  multitage system. 
Characteristically, telecommunications use complex systems in 
which the individual sections are connected in cascade so that the 
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uout / Uo 





=j 


Fig. 8.3 Response of an RC-network to an exponential video pulse. (Note 
that the network smoothes the input signal.) 


output from a previous stage acts as the input signal for the next. 
An example is a multistage amplifier. 

Suppose that we know the frequency responses of the individual 
stages K,(jo) (n=1, 2, ... N), where N is the total number of 
stages. If the excitation for the first stage is 


uin (t) = exp (jot) 

its output signal will be 

uout (t) = K, (jo) K- (jo)...Kw (jo) exp (fat) 

Hence, the overall frequency response of the system is 


N 
Koveran(jo) = H Ku (jo) (8.55) 


n=1 
* 


In engineering practice, the amplitude (magnitude) response of 
systems is ordinarily expressed in decibels, special logarithmic units. 
If at any frequency o we know the magnitude of the frequency 
response, then the gain of the system at that frequency, as expressed @ ~ 
in decibels, will be Decibels 





A = 201og;o| K (jo)] (8.56) 


A system for which |K(jo)| «1 will attenuate the signal, and 
instead of a gain we have a loss, or negative gain. 

It is an easy matter to see that when several stages are connected 
in cascade, their gains are added together: 


N 
Aoverall = Y An (8.57) 


n=1 





243 


244 


The input signal 


~ 


i : 

| 
he 3 
| | 
| 
| | 
| | 
| | 
| | 
| | 
| | 
| | 
| | 
| | 





and the output signal 
ofa differentiating net- 
work 
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Differentiating and integrating networks. In telecommunications, 
linear circuits are frequently used to change the waveform of pulse 
signals. 

Consider an RC-network for which the output signal is the 
voltage across the resistor. The differential equation of this system 
is 


tdor /dt + vg = tdvin /dt (8.58) 
If the time constant t is so small that 
t |dvg /dt| « | vn] (8.59) 


at any instant of time, we may neglect the first term on the left- 
hand side of Eq. (8.58) in comparison with the second, and so 


UR X t dvuin/dt (8.60) 


that is, if the condition (8.59) is satisfied, the RC-network performs 
the approximate differentiation of the applied signal. In practical 
applications, differentiating networks are used for pulse peaking (or 
sharpening). 

Clearly, whether the inequality (8.59) is satisfied or not depends 
not only on the circuit parameters, but also on the characteristics of 
the input signal For estimation purposes, it is simpler and more 
instructive to use analysis in the frequency domain. The frequency 
response of the circuit in question 

jot 
K (jo) = ———— 

(jo) 1 +jot 
will be close to that of an ideal differentiator 
K (ja) x jot 
if the product œt is negligible in comparison with unity in that fre- 
quency region where the bulk of the signal energy is concentrated. 
As an example, let the input signal be a rectangular video pulse of 
duration tp. Using a rough estimate for the upper frequency limit 
(the bandwidth) of the pulse 


Olim = 2%/Tp 


we obtain the condition for the applicability of an RC-network for 

the approximate differentiation of such a signal 

t= RC « 1p/2n (8.61) 
If in an RC-network the output signal is picked off the capacitor, 

the situation. will be the reverse of the previous case. Here, 


tduc /dt + vc = vin (t) 
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and, if the circuit and excitation parameters are such that 
1 [dvc /dt| > | vc] 


then 





t 


l 
vc (t) x P | uin (S) d$ (8.62) 


-0 





An RC-network possessing the above properties is called an 
integrating network. 

The accuracy of approximate integration improves as the fraction 
of h.f. components in the spectrum of the excitation increases. To 
demonstrate, since here 


K (jo) = 1/(1 + jot) 
then the approximate equality 


K (jo) x d/jot 


assuring the integrating properties of the network will take place if 
@t > 1, where œ is the lower frequency limit of the signal 
bandwidth. 

Integrating networks capable of suppressing the h.f. components 
of the input signal are oftgn used as smoothing filters. Also, they 
can convert stepwise changes in the input signal (step inputs) into 
a lineary rising (or ramp) output voltage. 

Geometric interpretation of signal transformation in a linear 
system. The spectral method provides a tool for an easy-to-grasp 
analysis of the transformations that a signal experiences in passing 
through a linear stationary system. From the view-point of the 
geometric concepts developed in Chap. 1, the system operator T 
defines the law by which one signal uin(t) in some linear space is 
transformed, or mapped, into a new signal uout(t). As a rule, this 
functional space is a Hilbert space. Then, in the most general case it 
may be argued that the operator T changes the norm of the signal 
uin (t), that is, 


|| uin] # || Tuin || 


Also, an angle W is formed between the signals uin and uou. 
By the Rayleigh formula (see Chap. 3), the energy of the output 


R 


Vin "T |" 


A 
Solve Problem 9 
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signal is given by 


10 
^ 


1 
Eout = || tout || 2 = Tu | Sout (©) Sut (0) do 


x 


= B f | K (j@)|? Win (o) do (8.63) 


where Win(@) is the power spectrum of the input signal. 
In accordance with (8.63), 


Wow (©) = | K (0)|? Win (c) 
The quantity 


Kp(o) =| K (ja)|? (8.64) 





is called the power transfer response at the specified frequency o. 
Since this function is real, the energy of the output signal is far 
simpler to find than the exact form of the output signal. It is to be 
noted that in many cases it is quite enough to know only the 
manner in which the energy of the signal passing through a linear 
system varies. 





Example 8.16. Let an RC-network with a frequency response 


K(jo) — 1/(1 -- jot) be driven by an ideal low-pass signal whose 
power spectrum is Wy in the frequency interval 0 < œ < Wc (where a 
is the cut-off frequency) and zero elsewhere. Find the input to output 
signal energy ratio. 

In this case, 


Kp(o) = 1/(1-F o?c?) 
By Eq. (8.63) 
[0] 
c 
do 
Eout = (Wy /n) [rcu = Unt arctn a 
0 


The energy of the input signal is 
Ein = Wgn 
Therefore, the energy ratio 
n = Eou/Ein = arc tan Ott) (8.65) 


Krlo) = K (jo) K( — jo) 
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tends to zero as both the time constant t and the cut-off frequency 


Og are increased. 





The angle between the input and output signal phasors. In Chap. 
1 it has been shown how two signals can be compared by finding 
the angle between the signal phasors in the Hilbert space. This 
idea can be utilized for comparing the input and output signals of 
a linear stationary system. 

By the generalized Rayleigh theorem, the scalar product of the 
two signals can be expressed in terms of their spectra 

oo 


M Sin(@) Sur (©) do 


(tin, tou= A 
ER Jj Sin (©) S* in () K* (jo) do 


X f Wis (o) K* (jo) do 


Since the imaginary part of the frequency response is an odd 
function of frequency, the above equation can be simplified as 
follows: 


TS zi Wis (&) Re K (jo) do (8.66) 


The angle V between the phasors of the input and output signals 
can be found from the relation 


A 
Solve Problem 14 


(uin, uou) 
cos yy = ———— — — — (8.67) 
|| “in || - || “out | 
"in Example 8.17. Find the angle w between the input and output 
signals in the RC-network of Example 8.16. 
Since here 
t 
0 Re K (jo) = 1/(1 + o?c?) 
p* it follows that the integral (8.66) is numerically equal to the square 
of the norm of the output signal. Hence, 
= t — arctan@ct V? 
0 cos y = Vn = ( ee ee (8.68) 


Mt jJ 


If the product ,t>»1, then cos y — 0, and this implies that the 


output signal of the RC-network is nearly orthogonal with respect 
to the input signal. An insight into this effect can be obtained from 
quantitative considerations, if we recall that the network delays the 
output signal owing to the lag in its response. 
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The autocorrelation characteristic of a system. Before we 
conclude our overview of spectral (frequency-domain) analysis as it 
is applied in the theory of stationary systems, one more useful 
function must be mentioned. This is the autocorrelation 
characteristic of a system, =(t). Customarily, it is defined as the 
Fourier transform of the power transfer function 


1 oo 
E(t)= E71 J K p(@) exp (jot) do (8.69) 


Alternatively, the function in (8.69) may be expressed in the time 
domain. To this end, we note that 


K p(o) = K (jo) K* (jo) 


Therefore the relation between K p(o) and E(1) must be the same as 
has been found (in Chap. 3) to exist between the power spectrum 
and the autocorrelation function of an arbitrary signal 


E= f h()h(t— 9)dt (8.70) 


8.5 The Operational Method 


There is a widely used operational method of analysis closely 
related to the spectral method just discussed. It is based on 
representing input and output signals by their Laplace transforms. 

Solving differential equations by the operational method. This 
method is an exceptionally flexible and powerful tool enabling one 
to solve linear differential equations with constant coefficients by 
formalized procedures. Precisely this property has made it so 
popular in the study of linear dynamic systems. 

Let the differential equation 





d"usut d"^ ! ugut duout 
an— Gynt Ant ae * eee +a, dt + Agout 
d" Uin d" -f Uin 
= bmm + bm-1 -gm + TP + bo uin (8.71) 


define the input-output relation for a linear stationary system. We 
impose an important constraint: We deem that uip(t)=0 for t <0. 
Also, in view of the class of problems dealt with in the present text, 
we deem that the system does not contain any stored energy up to 
the instant when the input signal occurs. Mathematically this means 
that we should choose zero initial conditions: 


uout (0) = Ugur (0) = ... = A (0) =0 


Finally, we assume that the area of feasible input signals does not 
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contain any functions so rapidly increasing with time that no 
Laplace transform exists for them. 

The correspondence between the original signal and its Laplace 
transform will be designated as follows: 


Uin(t) =Uin(P), uou(t) =U out(p) 
On taking the Laplace transforms of both sides of Eq. (8.71), we 
get 
(anp" + an_ yp" 1+... + aP + do) Uour(p) 
= (bmp + by yp" 1 +... + bip + bo) Vin(p) (8.72) 


The most important characteristic that forms the basis of the 
Laplace transform method is the ratio of the transform of the out- 
put signal to the transform of the input signal: 





K (p) = Uou(p)/U in(p) (8.73) 





called the transfer function of a system. 
In accordance with Eq. (8.72), 


_ bmp bs ap" | +... + bip bo 
asp" + ay ,p" | c apo as 








K (p) (8.74) 


Within the framework of the Laplace transformation, the transfer 
function is a complete mathematical model of the system. If the 
transfer function of a system is known, the response of the system 
to a specified excitation can be found by a procedure which can be 
broken down into three steps: 


(1) uin(t) ^ Uin(p) 


(2) Uout(p) = K (p) Uin(p) 
(3) Uout(p) > uou(t) 





Historically, the operational method goes back to the operational 
calculus proposed by Heaviside as far back as the end of the 19th 
century for solving differential equations describing non-stationary 
processes in linear electric circuits. The Heaviside method is based 
on the formal replacement of the differentiation operator d/dt with 
a complex number p. (For connections between the Heaviside and 
Laplace transform methods the reader is referred to [11]) 

Properties of the transfer function. Comparison of Eqs. (8.74) and 
(8.41) will show that the function K(p) is an analytic continuation 
of the frequency response K (jo) from the imaginaly (jo) axis to the 


e 
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of a system 
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entire plane of the complex frequency p= o je. The function 
K (p) is analytic over the entire p-plane, except for a finite number 
of points p, p;. ..., Pn, Which are the roots of the denominator in 
(8.74). These points, that is, the roots of the equation 


asp" a, ,p" For ...taptag-0 


are called the poles of the transfer function K (p). 
The set of points z,, Z3, ..., Zm, Which are the roots of the 


equation 
bmz + b, ,z" 1 uoc biz by =0 


are the zeros of the transfer function. 

On placing out the common multiplier Ky which arises when the 
numerator is divided into the denominator in Eq. (8.74), we may 
write K(p) in the so-called pole-zero representation: 





_  @=21)(P — z3)..p — zm) 
Ep Ko p=) — 2-19 99 


Since the coefficients of the differential equation (8.72) are real, 
the poles and zeros have an important property: They are all either 
real or form complex conjugate pairs. 

Frequently, the transfer function is depicted graphically by means 
of the so-called pole-zero diagram which is a plane where the 
coordinates of the points are marked by suitable symbols. The 
transfer function K (p), being complex, cannot in itself be presented 
in graphic form. Therefore, the usual procedure is to show the 
three-dimensional surface of the function | K (p)| over a plane with 
Cartesian coordinates (Fig. 8.4). 

The surface has a typical "mountainous" appearance, with the 
infinite peaks corresponding to the poles of the transfer function, 
and with the valleys to its zeros. On cutting the surface with 
a plane which contains both the vertical axis and the jw-axis, we 
obtain the amplitude response profile of the system. 

The poles of the transfer function for a linear circuit are nothing 
but the roots of the characteristic equation (8.36). Therefore, for 
a system to be absolutely stable, it is necessary and sufficient that 
these poles lie only in the left-hand half of the p-plane. In the 
general case, the zeros of the transfer function may be located in 
both the left-hand and the right-hand half of the p-plane. 

The Laplace inversion formula. The final step in finding the 
response of a linear system to a signal by the Laplace transform 
method is the recovery of the original time function for which the 
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Fig. 8.4 The appearance of the K (p) surface for a transfer function having 
two complex conjugate poles: p;,= —a+/j@ , and one zero: z=0 


Laplace transform is 
U out(p) = K (p) U in(p) 


Consider the special case when the function U out(p) is the ratio 
of two polynomials in powers of the complex frequency: 


U out(p) = M (p)/N (p) 


such that the power m of the numerator does not exceed the power 
n of the denominator and also the roots of the denominator pj (i= 
=1, 2, ..., n) are simple. 

The method by which the priginal time function can be recovered 
from its Laplace transform is based on the representation of 
Uout(p) as a sum of partial fractions: 


n l 
Venu - D » p — Pi 
The coefficients Cj are the residues of the function Uoy,(p) at poles, 
therefore [11] 
Vet E Tepr 
As will be recalled, 1/(p — pj) is the Laplace transform of exp (pit). 
Hence, the following Laplace inversion formula results from (8.75): 











(8.75) 


M(p 
N'(p 





j exp(pit) (8.76) 


Uout(t) = > 
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Example 8.18. Find the step response of an RC-network. 
Here, o(t) =1/p and K(p)=1/(1 + pt). Therefore, 


Ucu(p) = 1/p(1 + pt) 
On expanding into partial fractions, we get 


1 
U out(p) = — — —— 7 
p 


The original time functions corresponding to the two terms on the 
right-hand side of the above equation are well known (see Chap. 2). 
The result is 


g(t) = [1 — exp( — t/t)] o (t) (8.77) 0 


Finding output signals by the Laplace transform method. In 
using the Laplace transform method, the bulk of the computational 
work can be avoided by reference to the widely known tables of 
Laplace transform pairs (see Appendix 4). 














Example 8.19. The response of an RC-network to a rectangular 
video pulse. Let the excitation applied to the RC-network shown in 
the accompanying figure be a rectangular voltage video pulse of 
known parameters Vy and T. Find the function describing the output 
signal. 

The Laplace transform of the input signal is 


Vin(p) = (Vo/p) [1 — exp( — pT)] 


The term exp( — pT) implies that there is a time shift by T. 
Therefore, on the basis of the results obtained in Example 8.18, we 
may write 


vc = (1 -e "")o() - v [1—e "7 ot- T) (8.78) 
It is more instructive to re-write (8.78) as 

vc(t) = Voll — e^") for0<t<T 

vc(t) 2 — Ve "(1 —e "5 for t» T (8.79) 








If the output signal is picked off the resistor, then for the same 
values of R and C, the voltage across the resistor will be 


Un(t) = vin — vc(t) 


The respective plots appear in Figs. 8.5 and 8.6. 

Example 8.20. The impulse response of a parallel resonant circuit. 
Let a lossy parallel resonant circuit be driven by a delta impulse of 
current in the common part of the circuit. The output signal is the 
voltage across the circuit. 

The equality V(p) — Z(p) (p) indicates that in this case the 
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Vc/Vo 


" t, ys 
0 0.5 1.0 1.5 2.0 


Fig. 8.5 Time variations in the voltage across the capacitor of an 


RC-network driven by a rectangular video pulse of T = 1ps duration: (1) 
for T/t 20.2; (2) for T/t=5 


tys 





Fig. 8.6 Time variations in the voltage across the capacitor of an 
RC-network driven by a rectangular video pulse of T = ips duration: (1) 
for T/t =0.2; (2) for T/t=5 


transfer function is the Laplace transform of the resonant-circuit 





impedance 
pRL p/C 
Z(p--—5 = E (8.80) 
p LCR-c-pL-R  p*+2ap+@6 
where x — 1/2RC and o = 1/LC. 
It is convenient to re-write Eq. (8.80) as 
Ej HE. Lx (8.81) 


(p + a)? + o 
where @f= Vo — à? is the natural frequency of the lossy resonant 
circuit (the frequency of its free response). 
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The Laplace transform of the delta-impulse of current is unity, so 
the impulse response of the network in question is the original time 
function corresponding to the Laplace transform in (8.81). From the 
tables in Appendix 4 we find 


exp( — at) 
C 


h(t)= (cos art — —sin art) (8.82) 
f 
If the resonant circuit has a high Q and a««@p, Eq. (8.82) can be 
somewhat simplified : 


exp( — at) 
C 


The impulse response of a resonant circuit and, indeed, that of 
any other linear oscillatory system has the typical form of 
a harmonic wave with an envelope exponentially decreasing in time. 

It is important to remember that Eqs. (8.82) and (8.83) hold when 
a resonant circuit is driven by an infinitesimally short current pulse 
whose area is, however, finite and is equal to 1 A s. On a real scale, 
this would be a very large quantity -a rectangular pulse of 1 ps 
duration would have a gigantic amplitude of 105 A. It is not 
surprising, therefore, that with C — 1000 pF such a pulse would give 
rise to a voltage of 10? V at the initial instant of time. A real pulse 
of 0.01 A amplitude and of 1 us duration has an area of 10 ^ ? A s, 
and for C — 1000 pF the initial voltage across the resonant circuit is 
a mere 10 V. 

To sum up, the equation used to calculate the voltage produced 
across a parallel resonant circuit driven by a short current pulse of 
an arbitrary waveform is as follows: 


h(t)= COS Wot (8.83) 


Apexp( — at) 
C 
where Ap is the area of the pulse. 
Example 8.21. The step response of a series resonant circuit. 
Here, the transfer function is 
1/pC og 
K (p) = = 2 Z 
pL+R+1/pC — p*42ap- 0$ 
where œ = R/2L. The excitation is the Heaviside function for which 


the Laplace transform is 1/p. Hence, 
2 


®o 
Vout (P) = ———3-— 
in p[(p + a)? + ox] 
From the table of Laplace transform pairs, we finally get 


tou) = (cos ort — P ort) (8.84) 





g(t) -1—e (Cos wet + sin Ort) (8.85) 
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As is seen from the plot of the function g(t), the unit step input 
causes the system to oscillate so that it approaches a new steady 
state asymptotically. 

Example 8.22. Connection of a harmonic emf source to an 





V "in RC-network. 
m iil Let 
t 
rj] Vin(t) = Vmsin og to (t) 
The Laplace transform of the above signal is 
Vp Go 
Vin(p) = — 
in(P) p " m 
R Since 
| K(p)=1/1 + pt) =a/(p + o) 
Vin Vout 
where «=1/t, it follows that 
Va 095 
V, 2 ae 
out(P) (p+ ap? + oi) 
Vout 





From the table of Laplace transform pairs we find 


Vin An —at a H 
—— —(e ^ — cos Mot + — sin ot 8.86 
o2 m "E ( 0 Wo 0 ) ( ) 

The first term in the parentheses on the right-hand side 
represents a decaying free (transient) response. If at» 1, the solution 
will only retain the forced (or steady-state) response which varies in 
time harmonically. 


Vout(t) zx 


Many more examples could be added to those given above, 


including more complicated ones such as the connection of 
a harmonic emf source to a resonant circuit. However, the exact 
solutions that are obtained are fairly unwieldy. It appears more 
convenient to carry out the analysis by the method applicable to 
nonstationary processes in oscillatory circuits, set forth in Chap. 9. 


Summary 

<> The relation connecting the input and output signals of a system is called the system 
operator. 

Systems are classed according to the properties of system operators. Systems may be 
linear or nonlinear, stationary or nonstationary, lumped-constant or distributed- 
constant. 

4X» The response of a linear system to a delta impulse is called the impulse response of 
that system. 

<> The output signal is the convolution of the input signal and the impulse response. The 


frequency response function and the impulse response function are related by 


a Fourier transform pair. 
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The free (transient) response of a dynamic system is defined by the roots of the 
characteristic equation. 

A dynamic system is absolutely stable, if all the roots of the characteristic equation 
have negative real parts. 

The frequency response of a linear dynamic system described by an ordinary 
differential equation is a rational function of frequency. 

The spectrum of the output signal is the product of the frequency response and the 
spectrum of the input signal. 


Review Questions 


1. 


Give several examples of linear and nonlinear, stationary and nonstationary systems. 


2. What are the conditions under which the response of a linear system to a short input 


e w 


OO —1 A tA 


pulse may be represented by the impulse response of the system? 


. State the condition for the physical realizability of a system. 
. Define the step response of a system. How are the step response and the impulse 


response related? 


. Define the frequency response function of a linear stationary system. 

. Formulate the Paley-Wiener criterion. 

. What is the salient property of dynamic systems? 

. Write the equation defining the frequency response of an aperiodically loaded 


small-signal amplifier. How 1s its cut-off frequency (bandwidth) defined? 


. What is the essence of the spectral (frequency-domain) analysis of dynamic systems as 


applied to their response? 


. What logarithmic units are used to express the gain of a system? 
. Draw up schematic circuit diagrams for a differentiating network and an integrating 


network and explain their principle of operation. 


12. How does a linear circuit transform the input signal phasor regarded as an element of 
the Hilbert space? 
13. What is the power transfer function? 
14. Define the transfer function of a linear stationary system. 
Problems 
1. The impulse response h(t) of a linear The circuit is excited by the signal 


stationary system is a triangular pulse: at. t»0 
v=] 


0, <0 


Find the response of the system. 
2. Calculate the impulse response of an 
ideal integrator for which 





t 
Vout(t) = f vin(5) dő 
0 
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3. The block diagram of a system has the 
form 





The arm A contains a delay unit which 
delays the input signal for a time T, and the 
arm B a scaler (amplifier) of gain Ky. Find 
the impulse response of the system. 

4. Write the differential equation de- 
scribing the following circuit: 
! 





ee) 
The equation must be written for the 
unknown function vour(t). 
5. Find the frequency response functions 
for the systems in Problems 3 and 4. 
6. Calculate the impulse response of the 
RL-network whose circuit diagram has the 
form 


L 
à (t) y | po 


7. Calculate the impulse response of the 
circuit examined in Problem 4. 

8. Analyse Eq. (8.53) for « = 1/RC. 

9. Establish the conditions under which 
the circuit shown in the accompanying 
diagram: 


network 
integral of the 


can serve as a 
an approximate 
signal. 

10. The multistage FET amplifier shown 
in the accompanying diagram contains 
a d.c. blocking capacitor Cp: 


taking 
input 


2 


As its name implies, its function is to block 
the transfer of the high d.c. potential from 
the drain of the previous stage to the gate of 
the next The amplifier is intended to 
amplify rectangular video pulses of duration 
T= 1 ms. Considering that the resistor value 
is R=0.5 MQ, and the FETs have an 
infinite input impedance, determine the 
value of Cp for which the gate voltage (see 
the schematic) drops by not more than 5% 
from its maximum level over the pulse 
duration T. 

ii. Find the transfer function of 
a two-stage amplifier consisting of identical 
RC-loaded stages. The parameters of one 
stage are gn = 10 mA V !, R=0.3 KQ, Ri= 
=7 KQ, and Cy — 120 pF. The capacitance 
of Cy (see Problem 10) is so high that its 
effect on the amplifier performance may be 
neglected. 

12. A series LCR resonant circuit is 
excited by 


vin(t) = ato (t) 
Derive the relations defining the manner in 


which the voltages across the capacitor and 
the inductor vary. 
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Advanced Problems 


13. Find the frequency response and the 
impulse response of the circuit shown 
below: 





14. An RC-network is excited by 
Vin(t) = Vy exp( — at)o (t) 


The output signal is picked off the capacitor. 
Determine the angle between the input and 
output signal phasors in the Hilbert space. 

15. Analyse the step response of an 
oscillator circuit using a model consisting of 
a weight suspended on a cord. The 
excitation is a step displacement of the point 
of suspension of the weight (pendulum) in 
a horizontal direction. Select by experiment 
the form of excitation that would move the 
system from one steady state to another in 
a finite time. Draw the conclusion about the 
limiting speed of response of the oscillatory 
system. (This problem is an illustration to 
the theory of optimal control [42] which is 
a rapidly expanding division of present-day 
cybernetics.) 


Chapter 9 


Response 
of Frequency-Selective Systems 
to Deterministic Signals 


Since their early days, telecommunication systems have been 
widely using frequency-selective linear circuits in order to extract 
wanted signals. Circuits in this class attenuate all frequencies except 
those lying in the relatively narrow band around the centre fre- 
quency. Frequency filtering is effective when the signal being 
processed is sufficiently narrowband. Examples are the various 
modulated signals examined in Chap. 4. 

Narrowband frequency-selective circuits or, as they are more fre- 
quently called, linear narrowband frequency filters, have a number 
of specific properties. In this chapter the reader will learn the 
techniques and procedures developed for the analysis and synthesis 
of such circuits, including their characteristics and responses. 


9.1 Models of Frequency-Selective Circuits 


The simplest frequency filter is a resonant circuit formed by 
appropriately interconnecting an inductor L, a capacitor C, and 
a resistor R. Series as well as parallel resonant circuits are dealt 
with in a course on circuit theory. Without going into a detailed 
derivation which is presumed to be known to the reader [25] we 
will re-state the basic points which will be frequently used in the 
subsequent discussion. 

Frequency response of a series resonant circuit. If we take the 
input as a voltage and the output as a current, the behaviour of 
a series resonant circuit driven by a harmonic excitation will be 
described by the complex input (or driving-point) admittance 


1 
Y(jo) 2 ——————— 9.1 
Uo) R + joL + 1/joC m 


At the resonance frequency, @res = 1/V LC, the admittance of the 
resonant circuit is purely conductive 


Yres = 1/R 

The quantity 

p=/L/C (9.2) 

is called the characteristic impedance of the resonant circuit. 
The frequency-selective properties of this system improve with an 
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Generalized detuning 


A 
Solve Problem 1 
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increase in its Q-factor defined as 


Q = p/R = Ores L/R = 1/Ores RC (9.3) 


It is customary to introduce the absolute detuning Aw of the input 
harmonic signal relative to the resonance frequency by writing the 
source frequency as 


O = Ores + AO 
and also the dimensionless relative detuning 
V = 0/®res — Ores/@ (9.4) 


which vanishes at the resonant frequency. 

Finally, there is the generalized detuning & which is defined as the 
ratio of the reactive impedance of the resonant circuit to the loss 
resistance: 





Ee x (oL - LjoC) = Qv (6.5 


The admittance of a series resonant circuit can be expressed in 
terms of the generalized detuning as 





1/R 


Y= 
1+ j$ 


=| Ylexp(o) (9.6) 





From Eq. (9.6), the amplitude response of the resonant circuit can 
be written as 


1/R 


|Y|= (9.7) 
yi LE 

and the phase response as 

@= —arctans (9.8) 


The plots constructed on the basis of Eqs. (9.7) and (9.8) appear in 
Fig. 9.1. 

The magnitude of the admittance decreases to 1/|/2, or 0.707 
times the resonant value at frequencies such that & = +1. Also, 


o( *e te - Ores )- i: 
Gres Gres + Aw 





If Q>1, the equality will be satisfied at low values of the ratio 
AQ®/®res. Therefore, approximately 


2QA@/Ores = + 1 
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IYIR Q, rad 





-3 -2 -1 0 
(a) (5) 


Fig. 9.1 Admittance of a series resonant circuit as a function of generalized 
detuning: (a) magnitude; (b) phase 


Hence, the bandwidth of the resonant circuit between the 0.707 
points will be 


BW, 79; = 2|A@| = Ores/Q (9.9) 


Frequency response of a parallel resonant circuit. At the 
resonance frequency a series resonant circuit has a very low 
impedance the magnitude of which sharply increases with the 
amount off resonance (detuning). For a parallel resonant circuit the 
impedance at resonance 


Rres = pQ (9.10) 


being likewise purely resistive, is a maximum in magnitude. 

Taking the input as a current, and the output as a voltage, the 
frequency response of a parallel resonant circuit is called the 
complex input ( driving-point ) impedance, Z (jo). It is convenient to 
express the frequency response function, taking the generalized 
detuning & as the argument: 





Z (76) = i (9.11) 


The plots of the amplitude and phase of Z (j6) are exactly the same 
as appear in Fig. 9.1 for the complex admittance of a series 
resonant circuit. 

If the Q-factor is sufficiently large so that in the direct vicinity of 
the resonant frequency we may express the generalized detuning by 
an approximate formula of the form 


E cm 2Q(@ — Ore) (9.12) 
Ores 


A 
Solve Problem 2 
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then the amplitude response, that is the frequency depedence of the 
magnitude of the input impedance, of the parallel resonant circuit is 
represented by the so-called resonance curve (also called the 
resonant curve or characteristic) which is symmetrical about the 
resonant frequency @yes. The equation of the resonance curve is 


R res 


Z (jo) | = 
aa y1 + 4Q? (o — Wres)”/Wies 








Owing to the fact that the magnitude of the complex impedance of 
a parallel resonant circuit sharply falls off with an increase in the 
amount off resonance (detuning), this circuit can advantageously be 


used for the frequency filtering of signals. 





Example 9.1. A parallel resonant circuit for which Q — 125 and 
L=6 uH is tuned to resonate at fres = 8 MHz. The circuit is driven 
by a harmonic current source; the output signal is the voltage across 
the resonant circuit. Determine the amount by which the signal will be 
attenuated at a frequency of 8.1 MHz as compared with the signal 
magnitude at resonance. 

For tuning to the desired resonant frequency, the capacitor rating 
must be 


C = 1/4n? Lftes = 66 pF 

The resonant impedance of the circuit is 
Rres = pQ = /L/C Q = 37.69 KQ 

By virtue of Eq. (9.12), the generalized detuning at 8.1 MHz is 
E = 20Mffres = 3.125 

Now the amplitude of the output signal is proportional to the 


| | Ab) | | 
| A ee 





7.7 7.8 7.9 8.0 8.1 8.2 8.3 


Fig. 9.2 Amplitude response of a parallel resonant circuit with Q = 125, 
L-6yH, and C —66 pF 
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magnitude of the resonant-circuit impedance. Since 
IZI/Rres = 1/1 + & 


then, on substituting the found value of & we find that the signal 
amplitude at frequency 8.1 MHz is 0.305 times the amplitude at the 
resonant frequency. 

This corresponds to a negative gain (loss or attenuation) 


A = 20log,, 0.305 = — 10.31 dB 


The amplitude response of the system is shown in Fig. 92. 

The specific shape of the amplitude response is an indication that 
the resonant circuit in question is a narrowband frequency-selective 
system. This is true because the ratio of the bandwidth to the 


resonant frequency is 
BW  707/fres = 1/Q =8 x 107?«1 





Frequently, use is made of tapped parallel resonant circuits. This 
means that the associated external circuit is connected to a tap 
down on the tuned-circuit coil (inductor). The input impedance of 
a tapped resonant circuit is found by Eq. (9.11) in which one inserts 
the purely resistive resonant impedance 


Rres= Rha pQ 


where kia — L;/(L, + L;) is the tapping-down factor with the 
inductive coupling neglected. 

The pole-zero representation of the response of resonant circuits. 
Consider Eq. (9.11) for the complex input impedance of a parallel 
resonant circuit and express the generalized detuning € in terms of 
the current frequency. Then 


2 Riss 

1 + jQ (0/Ores — Ores/@) 
On changing from the frequency variable jo to the complex fre- 
quency p. we obtain the Laplace transform of the tuned-circuit 
impedance 


(9.14) 


Ries am p/C 
1 + Q(p/Ores + Ores/p) p + POres/Q + Ores 


The transform Z (p) has an only zero for p — 0 and two complex 
conjugate roots 


P12 = — Ores/20 t j|/1 — 1/40? Ores (9.15) 


The poles are located in the left-hand half-plane (the system is 
stable), and as their distance to the imaginary axis decreases the 
Q-factor of the system improves. This property is common to all 
frequency-selective systems. 





Z(p)= 








Connection across part 
of the  tuned-circuit 
inductor instead of the 
whole of it brings down 
the resonant  impe- 
dance without exten- 
ding the bandwidth 


Imp 


The pole Q-factor 
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+E sup 


Le i (jw) Vou 


Output 





Input 
g- X a 
(a) (b) 


Fig. 9.3 Small-signal tuned amplifier: (a) schematic diagram; (b) equivalent 
circuit 


Sometimes it is convenient to introduce a special numeric 
characteristic called the pole Q. or Q oie, defined as the ratio of the 
absolute values of the imaginary and real parts of the pole 
coordinates. As follows from Eq. (9.15), in our case 


Qpoie = [Im p; ;l/|Re p,,;1 x20 


The small-signal tuned amplifier. This system combines the 
functions of an amplifier and of a linear frequency filter (Fig. 9.3). 

It differs from an RC-loaded amplifier (see Chap. 8) in that the 
load is a parallel resonant circuit. Generally, the electron device of 
the amplifier (which may be an electron tube or a transistor) is 
tapped down on, that is, connected across part of, the tuned-circuit 
coil. 

Referring to the equivalent circuit of the amplifier, it is seen that 
the current —g,, Vi, supplied by the controlled source flows 
through an impedance given by 


and produces across it a voltage drop which is the output signal of 
the amplifier. Simple manipulations show [see Eq. (9.11)] that 


. R res, 
Zeq(j@) = rpm + js (9.16) 
where 
Rres 
R = M 9.17 
res, eq 1+ RreJRi ( ) 


is the equivalent impedance of the amplifier tuned circuit at 
resonance, as corrected for the internal resistance of the source 


= 6 
Seq= 1+ RR; 
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It may be taken that the effect of the internal resistance of the 
source consists in bringing down the Q-factor of the resonant 
system so that it becomes equal to an equivalent Q-factor 


Q 


- 9.18 
1+ Ryes/Ri 0.18) 


Qeq 


As follows from Eq. (9.18), in order to minimize the shunting 
effect of the electron device on the tuned circuit without having to 
expand in the bandwidth of the amplifier, one should bring down 
the resonant impedance Rye, by tapping the electron device down 
on the tuned-circuit coil. Since the complex amplitude of the 
harmonic signal at the amplifier output is 


Vout = —9mZeq Vin 
the frequency response of the system is 
K (jGeq) = — gm Rres,eq/(1 + j§eq) (9.19) 


Hence, the amplitude response and the phase response of the 
amplifier have the form 


R 
IK (io) | = na 0.20) 
1+ 4Qeq (© — Gres) 
2 
Ores 
Qx(o) — x — arctan 2Gea( — Ores) (9.21) 


Ores 


A 
Work Problem 5 


Example 9.2. For the amplifier shown in Fig. 9.3, fres = 28 MHz, 
Q—95, p —430Q, kq4— 0.6, g4 —20 mAV ^ !, and Rj—15 KQ. 
Find the gain at resonance and the bandwidth of the amplifier. 

The resonant impedance of the tuned circuit is 


Rres = klapQ —0.36 x 043 x 95 = 14.17 KQ 


The equivalent impedance of the tuned circuit at resonance, as 
corrected for the shunting effect of the transistor, is 


14.71 
R = —_____ = 743 kQ 
USE Ya 14.71/15 


At resonance, Eeq=0, so, as follows from (9.19), the gain at 


resonance is 
Kres = gm Rres, a~ 148.6 
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Ares = 2010839 K res = 43.44 dB 
The bandwidth of the amplifier between the 0.707 points is found 


by Eq. (9.9) 


BWo.707 — fres/Qeq = 0.584 MHz 











Multistage frequency-selective systems. The simple narrowband 
circuits we have examined suffer from a serious drawback-a low 
frequency selectivity. This property manifests itself in that outside 
the passband their amplitude response rolls off slowly or, which is 
the same, the rate of cut-off is low. Therefore, the output wave 
contains not only the valid signal whose spectrum lies near the 
peak of the amplitude response, but also a definite, sometimes 
considerable proportion of interfering signals, noise, etc., with their 
spectra lying rather far from the frequency to which the filter is 
tuned. 

One way to improve the frequency selectivity of filters is to use 
several resonant circuits in tandem, so that the overall amplitude 
response is nearly rectangular. 

A simple example of multistage frequency-selective systems is 
a system of two inductively coupled tuned circuits. Its operating 
principle is examined in a course on circuit theory. Figure 9.4a 
shows the schematic diagram of a tuned amplifier loaded into 
a system of two identical inductively coupled tuned circuits. 

The important parameters of this system are the coupling 
coefficient (or coefficient of coupling), kc — M/L, and the coupling 





Fig. 9.4 Inductively-coupled tuned amplifier: (a) schematic diagram; (b) 
plots of amplitude response for several values of the coupling factor 
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factor, A = kQ. The amplitude response of this amplifier is defined 


as 
IK (GE) = kia AgmR res, eq - 
(1 + A? — £y? + 4g? 

Plots of the amplitude response based on (9.22) are constructed for 
several values of A in Fig. 9.4b. It is to be noted that if A > 1, the 
resonance curve within the pass band has a dip which increases 
with increasing A. If we compare the amplitude responses of 
a single-tuned and a double-tuned amplifier, we will note that, 
given the same Q-factor, the double-tuned-circuit amplifier has 
a resonance curve with a faster rate of roll-off, that is, a better fre- 
quency selectivity. 

By using a large number of inductively coupled resonant circuits 
connected in tandem, it is possible to synthesize highly efficient fre- 
quency-selective systems. 

A recent trend in communication practice has been to use active 
frequency-selective filters based on novel circuit-engineering 
principles (see Chap. 14). Much headway has been made in the 
design of filters utilizing wave phenomena in solids. This new field, 
called acoustoelectronics, holds out great promise for the synthesis 
of miniature and reliable frequency-selective systems. 

Idealized models of frequency-selective devices. When treating 
frequency-selective systems theoretically, it is advantageous to use 
their simplified models which adequately represent the most 
important aspects of filter behaviour and omit minor details 
which are hard to analyse anyway. 

The simplest model in this class is the hypothetical ideal bandpass 
filter which has a flat frgquency response equal to K, within the 
pass band: 





(9.22) 


(Ko for — 0o — Ao « 0o « — 0g + Ao 


K(jo) =< K, for oj — Ao < 0 < 0o + Ao (9.23) 


ŁO elsewhere 
Another widely used theoretical model of narrowband systems is 
the so-called Gaussian radio filter for which the amplitude response 
function is a bell-shaped Gaussian curve symmetrical about fre- 
quency og. The frequency response of a Gaussian radio filter is 


K (jo) = Ky exp[ — b(o + o9]  Koexp[ — b(o — oo] (9.24) 


Here, b is a constant defining the frequency properties of the filter. 
The first term in (9.24) represents a "spike" in the negative-fre- 
quency region, and the second term, a "spike" in the positive-fre- 
quency region. If bo » 1, the filter is a narrowband one, and no 
overlap occurs between the frequency responses corresponding to 
the negative and positive frequencies. 
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e 
The ideal bandpass fil- 
ter 





—Wo 0 Wo 
& 
The Gaussian radio 
filter 
Ko 
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9.2 Response of Frequency-Selective 
Circuits to Broadband Excitations 


It is interesting to know the response of a narrowband frequency- 
selective circuit to a broadband excitation because interfering signals 
are frequently very short pulses. Since the bandwidth of a pulse 
increases as its duration is decreased, the effective bandwidth of 
such interfering signals may substantially exceed the pass band of 
the frequency-selective system involved. 

The concept of broadband signal Let K (jo) be the frequency 
response of a frequency-selective circuit capable of extracting the 
spectral components of the input situated in the vicinity of fre- 
quencies +@,. The excitation uin(t) with spectrum Sj,() is called 
broadband with regard to the given circuit, if S;,(@) may be taken 
as being approximately constant within the pass band of the 
system. Then, 


Sin( = Wy) H 





uout% = OM T K (jo) exp (jot) do 
Sin(@o) © 7 . 
J K Go) exp Gat) do (9.25) 
2n b 


As follows from Eq. (9.25), the waveform of the output signal is 
decided by the frequency response of the system, and not by the shape 
of the excitation. The spectrum of the excitation within the pass 
band of the system determines the scale of the response. 

The impulse response of a frequency-selective circuit. A signal 
with an infinitely broad bandwidth is the delta impulse for which 
Sin(@) = 1. In this case, the output signal is the impulse response 
h(t). According to (9.25), 


oo 


0 
h(t)— 2 f K (jo) exp (jot) do + EA f K (jæ) exp (jat) do (9.26) 
2n ^ 2n 9 


Consider the first term on the right-hand side of (9.26) 
and replace its integration variable o with a new frequency vari- 
able Q: 


O= —M—-2 


This change implies that the frequency response function K (jo) is 
moved from the neighbourhood of the frequency —@, into the 
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neighbourhood of the point Q=0. Therefore, 
— exp( — jogt) 


A TOT 
E dT K (jw) exp (jat) do = = 


-00 


x J K[—jí(o, +Q)] exp(—jOr)dQ 


exp(—jogt) 7 
—— f K[ —j(o, + O)]exp( — jon do (9.27) 
- (0p 
Since the circuit in question is a narrowband one, the amplitude 
response sharply decreases with increasing Q. This means that in 
the last integral of (9.27) the lower limit — & may be replaced with 
— o: 


| 9 exp( — jogot) 
X. Le io) exp (jot) do = —— 
x f K[—j(o, - Q)] exp( —j0) dO (9.28) 


Similarly, by a change of variable, o = o, +Q, the second 
integral in (9.26) can be re-cast as 


exp Goo f 


5. | KUindexp (iat) do = | K [/(o, Qj] exp (jan do 
0 


(9.29) 


Since the complex conjugate expressions (9.28) and (9.29) 
combine, the expression.for the impulse response of a narrowband 
system takes the form 


í K [j (@ + Q)] exp (Ot) dQ exp (jogt) (9.30) 


Moo 2Re} t | 





The low-frequency equivalent of a frequency-selective network. 
This refers to an imaginary system whose frequency response is 
obtained by shifting that of a real narrowband network from the 
vicinity of frequency wọ into the neighbourhood of zero frequency, 


that is, 


KGN) = K [j (os + Q)] (9.31) 
The integral in (9.30) is the impulse response of the ! f. equivalent 


1 oo 
hi) =>— f KirGQ)expGQ1 do (9.32) 
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Therefore, 


h(t) = Re [2hi(t)exp (fat) ] (9.33) 


It follows then that the function 2hy;(t) is the complex envelope of 
the impulse response of a real narrowband network. As follows 
from (9.33), the impulse response of a frequency-selective system is, 
in the general case, a quasiharmonic wave the envelope and initial 
phase of which vary slowly in time (on the time scale T = 2n/oy). 


Example 9.3. The Lf. equivalent of a parallel resonant circuit. 
Here, the frequency response of the system is its complex input 


impedance 
R res 





Z (jo) — 
1+] 


Ores 


(9.34) 


. 20 (© — Ores) 


The frequency response of the Lf. equivalent can be obtained by 
a change of variable & = @.e5+ Q in (9.34): 


res 


200 
1422 


Z(jQ)= 





Ores 


(9.35) 


To within the scale factor Ryes, this is the frequency response of 
a Ist-order dynamic system (similar to an RC-network) with a time 


constant 





Tekt = 20/@res 


e 
(9.36) The tuned-circuit time 
constant 


called the tuned-circuit time constant. 
The impulse response of such a network has been found in Chap. 
8 when examining the properties of the RC-network: 


hit) = (Rres/Tckt)exp( — t/veki) for t>0 (9.37) 

Thus, the impulse response of a parallel resonant circuit is 
h(t) = (R res @res/Q) exp ( — t/T ext) cos Wrest (9.38) 
Since 


Ryes@res/Q =1/C 


where C is the resonant-circuit capacitance, the result thus obtained 
fully checks with that found in Example 8.20. 

Example 9.4. Find the impulse response of an idealized narrowband 
system whose frequency response is 


K (jo) = Ky exp[ — b(@ — o9)] o (o — o) 


for 9» 0. 
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On shifting the above function into the vicinity of zero frequency, 
we obtain the frequency response of the lf. equivalent 


KQ) = Ky exp( — b9) o (Q) (9.39) 


Hence, the corresponding impulse response is 





K o 
hy(t) = n fexp[ - (b —jt)Q]dQ = K,/2n(b — jt) (9.40) 
T o 

It is to be noted that h(t) is a complex-valued function. There- 
fore, the l.f. equivalent of the filter in question is not a physically 
realizable network. This, however, does not stand in the way of 
obtaining the impulse response of the original system by use of Eq. 
(9.33): 

K | K 

h(t) - R Eo RS t — tsin Wot 

(t) " xb — jt) exp (jo d z Ms (b cos Wp sin ot) 


Example 9.5. Find the impulse response of the double-stage tuned 
amplifier whose schematic diagram is shown in Fig. 9.5. 

Assume for simplicity that the two stages are tuned to the same 
resonant frequency Ores, have the same gain at resonance Kres, and 
the same tuned-circuit time constant tci. Then the frequency 
response of the amplifier is 


2 
K res 


K (jo) = 
EN [1 + jTckt (o p Ores)]? 





Hence, 
Ky (Q) = KA + JO)? 


` On replacing the frequency variable jQ with the complex fre- 


T Esup 





Fig. 9.5 Two-stage amplifier (the circuit components printed in black 
perform auxiliary functions): R, through R, apply initial bias to transistors 
T, through T, ; Cy-d.c. blocking capacitor 
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7 h(t) Tckt/ (2K des) 





Fig. 9.6 Impulse response of a two-stage tuned amplifier 


quency p, we get 
Kilp) = Khs (1 + pta? = (K fes/tek)/(p + 1/Texs)? 


From tables of Laplace transform pairs we find that the above 
transfer function corresponds to the impulse response 


hy(t) = (Kfes/ text) t exp ( — t/teki) 
Hence, the impulse response of the two-stage amplifier is 
h(t) = (2K fes Toki) (t/tckd exp( — t/Tekt) COS Wrest (9.41) 


A plot of the impulse response is given in Fig. 9.6. 

It is instructive to compare this result with the impulse response 
of the single parallel tuned circuit in Example 8.20. As is seen, the 
output pulse is ^pulled" in time because of the appreciable time lag 
associated with a double-tuned-circuit system. 


The general case. Suppose that a frequency-selective system is 
driven by an arbitrary broadband signal whose spectrum is 


Sin(@) = A (e) + jB(@) 
Let ujn(t) be a real function. Then 
A(@)= A(—@) and B(o)2 — B(— o) 
Let us write the output wave as a sum: 


Uout(t) = uSde(t) + jug) 





Here, 
u 0 
u(t) = — f K (jo) exp (jot) do 
+ Ao) J K (ja) exp (jot) do 
2n b 


= 2A (og) Re [h(t exp aot) ] 
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Similarly, 
S 0 
dn) = =F | K Gojexp (jor) do 
+ B(@o) f K (jm) exp (jat) do 
2n 9 
= j2B(og)Im [hi(n) exp (oot) ] (9.44) 


Substituting (9.43) and (9.44) in (9.42) finally yields 


Uout(t) = 2 (A (o) Re [hii(t) exp gt)] 
— B (©) Im [hi(t) exp (991)]] (9.45) 


As a special case, Eq. (9.33) describing the impulse response of 
a narrowband network naturally stems from (9.45). 

The physical significance of the spectral expansion. Assume for 
simplicity that hy(t) is a real function, and write Eq. (9.45) as 


Uout(t) = 2hir(t) [A (Wo) cos Mot — B (cg)sin oer] 
= 2hy(t) / A? + B? cos (wot + 9) (9.46) 


where ọ — arc tan (B/A) and V4 + B? = |Sin(@p)|. 

Thus, we may conclude that the response of a narrowband 
network to a broadband signal is proportional to the absolute 
value of the spectrum of the excitation at the point on the fre- 
quency axis corresponding'to the central frequency of the network's 
pass band. 

This suggests an approach to the hardware implementation of 
signal spectrum analysis. Figure 9.7 shows the block diagram of the 
parallel type of spectrum analyzer. 

The spectrum analyzer shown in Fig. 9.7 consists of a number of 
narrowband filters whose passbands do not overlap. By measuring 
the amplitudes of the output waves simultaneously, it is possible to 
obtain information about the intensity of the spectral components 
of the input signal at some points along the frequency axis. 

The above principle of spectrum analysis implementation is of 
important significance both practically and theoretically. Among 
other things, it brings out the physical significance of the behaviour 
of the signal spectra examined in Chap. 2. For example, it has been 
found that the spectrum of a rectangular video pulse of duration t; 
is zero at all frequencies o, = 2nn/1y (n = 1, 2, ...). Suppose that this 
video pulse drives a very narrowband resonant network tuned to 
one of these frequencies. The ratio of the natural period of the 
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Fig. 9.7 Block diagram of a signal spectrum analyser. (The amplitudes of 
the filter outputs are proportional to the magnitudes of the spectra.) 





network to the pulse duration: T, — 21/05 — vy/n is an integer. On 
being driven by the leading edge of the input pulse in one direction, 
the system will be "kicked" by the trailing edge of the same pulse in 
the opposite direction in a time which is a multiple of the network's 
natural period. As a result, the two responses will cancel each other. 
Precisely this occurrence is corroborated by the zero values of the 
spectrum of the video pulse at some points along the frequency 
axis. 

An excellent presentation of material on the physical aspects of 
spectral expansion will be found in [7]. 


9.3 Response of Frequency-Selective 
Circuits to Narrowband Excitations 


In a typical situation, such as in the reception of modulated 
signals, a frequency-selective linear filter is driven by a valid signal 
the spectrum of which has a well-defined peak within the pass band 
of the filter. As a rule, the resonant frequency of the tuned circuit is 
the same as the carrier frequency (symmetric tuning). 

If the spectrum of the input signal were strictly bounded to the 
frequency band within which the frequency response of the filter 
remains constant, the output signal would be a scaled replica of the 
input signal. However, both the amplitude response and the phase 
response of a frequency-selective network are far from 1deal, and 
this leads to distortion in the waveform of the output signal. 
À method by which one can determine signals at the output of fre- 
quency selective systems driven by narrowband waves is set forth 
below. 

Basic relations.Let us consider an arbitrary narrowband network 
whose frequency response K (jo) is substantially nonzero only in 
the vicinity of points + o, on the frequency axis. Suppose that the 
excitation is a narrowband (quasiharmonic) wave whose central fre- 
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quency is Og. This means that in the equation 
uin(t) = Re [Uin(t) exp (jaof)] (9.47) 


the complex envelope Uin(t) varies more slowly than the wave 
COS Wot. Let the correspondence between the signals and their 
spectra be designated as 


Uin(t}>Sin(@), Uin(t)}->G in() 


such that (see Chap. 5) the spectra of the excitation and of its 
envelope are connected by a relation of the form: 


1 l 
Sin(0) = > Gin(o — Oo) + 5 Ga — 0 — Wo) 


Hence, by using the fundamental equation of the spectral 
method, we obtain the following expression for the output signal: 


0 
Uout (t) = a J G*,( — © — Wo) K (jo) exp (jot) do 


| x 
+ dr Í Gin(@ — @9) K (jo)exp (jot) do (9.48) 
0 
By a change of variable, o = — @, — Q, in the first integral, we may 
re-write it as 
ae: . . 
Tr pi G#(— o — Oo) K (ja) exp (jot) do 
| : ; : 

ur f GRO)K[ — (og + Q)]exp( — jQ) dQexp( — jaot) (9.49) 


Similarly, on inserting © = @) + Q, the second integral in (9.48) 
may be re-written as 


l Lo 
P. Í Gin(@ — o4) K (jo) exp Gat) do 
0 


- = f Gin (Q) K [j(@p + Q)] exp jQt) dQ exp Uont) (9.50) 


In taking the sum of the right-hand sides of (9.49) and (9.50). it is 
to be noted that the two expressions are complex conjugates of 
each other. Also, on the basis of Eq. (9.31), the term K [j (@ + Q)] 
is the frequency response of the Lf. equivalent of a narrowband 
network. Therefore, 


| - i 
uout = Re| 3 | Gu (€) K lj )exp GON) dtexp (joon) | 
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Hence, the expression for the complex envelope of the output 
signal is 


. 3 
Uou(t) = 5 J Gin(Q) KiQ) exp (Q1) dQ (9.51) 


It should be interpreted as follows: The complex envelope of the out- 
put signal is a slowly varying wave whose spectrum is 


Gout (Q) = Gin(Q) Ky GQ) (9.52) 


In order to find the output signal of a frequency-selective 
network driven by a narrowband signal, we should first determine 
the response of the l.f. equivalent of the original network to the 
complex envelope of the excitation. The final step will then be to 
recover the physical output signal: 


uout(t) = Re [U our(t) exp ()] (9.53) 





Equation (9.51) corresponds to the spectral (frequency-domain) 
method of finding the output signal of an l.f. equivalent. Other 
methods, such as the Laplace transformation and the Duhamel 
superposition integral, may be used as well. In accord with the 
Duhamel superposition integral method, 


t 
Dourlt)= f Uin(t) h(t — t) dt (9.54) 
where hift) is the impulse response of the 1. f. equivalent. 


Response of a single-stage tuned amplifier to an AM signal. We 
seek to find the response to a single-tone AM wave 


uin(t) = Ug (1 + M cos Qt) cos Wot (9.55) 

of a single-stage tuned amplifier whose frequency response is 
—K 

K (jo) = = (9.56) 


1 + jtckt(@ — Ores) 

Let us adopt an important simplifying assumption that the 
resonant frequency Ores and the carrier frequency @, are the same. 
The complex envelope of the input signal is 


Uin(t) = U, (1 + M cos Or) (9.57) 
The frequency response of the lf. equivalent of the amplifier is 
K GQ) = — Kees (1 + jOtck) (9.58) 


The complex envelope of the output signal may be found from 
(9.57) and (9.58) by the usual method of complex amplitudes known 
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from circuit theory: 

Kies U,M 
y1 + OH 
where 9 = arctan Qt,,;. On substituting this expression in (9.53), 
we finally obtain 





Dout(t) = — Kres Ug — cos (Qt — 9) 


Uout(t) = — Kres Ug | + cos (Qt — J COS Wot 


V1 + Q? Tt 
Since the tuned-circuit time constant is 
Tekt = 2Q res/O res 


the above relation may be re-cast as 





Uout(t)= — Kres Us| + yu cas (Ot J COS Wot (9.59) 


where &o = 2Q resQ/res is the generalized detuning of the amplifier 
tuned circuit at the upper side frequency. 

Thus, the wave appearing at the amplifier output is likewise an 
AM signal, but boosted in amplitude. It differs from the input 
signal in that it has a smaller modulation factor (or modulation 
depth): 


Mou Miy/ 1+ && (9.60) 


EA 
Solve Problem 8 


Also, the envelope of the oütput signal is delayed from the envelope 
of the input signal by a time tq — 99/Q. 


Example 9.6. Let an AM-signal of M = 0.8, ©) — 5 x 1098 s^ ! and 
Q —3 x 10* s^! drive an amplifier tuned to the carrier frequency. 
The equivalent Q-factor of the amplifier is Qeq= 75. 

In this case, 


Eg=2 x 75 x 3 x 10*/5 x 1065 « 0.9 
Hence, by virtue of Eq. (9.60), 
Mou = 0.8/|/1 + 0.81 = 0.595 


As is seen, the depth of modulation is substantially reduced. 
Because arc tan 0.9 = 0.733 rad, the envelope is delayed for a time 
ta = 0.733/(3 x 10*) = 24.43 ps. 











Response to a truncated voltage sinewave. In many 
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communication systems (radar, multichannel radio links, etc.) the 
useful information is transmitted by means of sequences of 
rectangular radio pulses. On passing through resonant frequency- 
selective networks which are integral parts of the respective 
receivers, these input pulses are somewhat distorted. In order to 
assess the degree of distortion, let us determine the output signal of 
a single-stage tuned amplifier whose frequency response is given by 
(9.56), when the input signal is 


Vin (t) = Vmcos 09 to (t) 

If Mres=@,, then, on taking this frequency as reference, we 
obtain the following expression for the complex envelope: 
Vin (t) = Vmo (t) (9.61) 


The effect of the signal defined in (9.61) on a system whose fre- 
quency response has the form of (9.58) has been examined in Chap. 
8 in connection with the step response of an RC-network. There- 
fore, by taking advantage of the already known result, we may 
write 


Vout(t)= — Kres Vm[1 — exp( — t/text)] o (0) (9.62) 


Hence, the output signal of the amplifier is 


Dout(f) = — Kres Vm[1 — exp( — t/tck1)] cos Wot (9.63) 


The plot corresponding to (9.63) appears in Fig. 9.8. 

The instantaneous amplitude of the input signal reaches 0.9 times 
its steady-state value, Kres Vm, over the time interval known as the 
rise time 


Tr = 2.303 1o = 4.6060 eq/Mres (9.64) 


Vout /(KresVm) 






t/Tokt 


Fig. 9.8 Transient response of a tuned amplifier tuned to the signal 
frequency 
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The effect of detuning. Now we will consider the previous 
problem in a more general form on assuming that the frequency of 
the harmonic signal differs from the resonant frequency of the 
tuned circuit by an amount ôo: 


Vin(t) = Vincos [(@res + 60) t] 
and 
Vin(t) = V exp (jóot)o (t) 


The simplest way to find the output signal from the lf 
equivalent of a single-stage tuned amplifier is to use the Duhamel 
superposition integral in which the impulse response of the Lf. 
equivalent 


hit) = — (Kres/tckt)exp( — t/tckt) o (t) (9.65) 


is inserted. 
On the basis of Eq. (9.54), we find 


K res V 


t 
Poul) = — — 7 fexpBox)exp[ — (t — cac] de 
c 0 
-Kelar 
= Ty jorg, P O0 — exp( — t/rok] (9.66) 


The physical envelope of the oscillatory waveform appearing at 
the output of a tuned amplifier is described by the magnitude of the 
complex output envelope 





~ Kres V 
Vout (d = | Pout (d) | = —— B - 
V1 + Vertex)? 
x yi — 2expí( — t/Tekt) cos d@t + exp( — 2t/Toxt) (9.67) 


The plots constructed by Eq. (9.67) for several values of the 
detuning 8c appear in Fig. 9.9. 

Thus, the difference between the resonant frequency of the tuned 
circuit and the harmonic carrier frequency of the output signal 
results in nonmonotonic variations in the envelope of the output 
signal. 

The physical interpretation of this fact is this: The output signal 
of an amplifier is the sum of the forced (or steady-state) response 
which has the frequency of the external source, and the free (or 
transient) response which exponentially decays with time and has 
a frequency equal to the natural frequency of the tuned circuit. For 
the duration of the output signal, the phasor Viree rotates at the 
difference frequency relative to the phasor Viorced. The envelope of 
the output signal, proportional to the length of the resultant phasor 
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Vout /(Kres Vm) 


arte 





Fig. 9.9 Transients in a tuned amplifier under detuning: (1) for 690144 = 1; 
(2) for 60144 = 3 


Vg, is time-varying, tending in the limit to the amplitude of the 
forced (steady-state) response. 

Interestingly, as the output approaches its steady state, the 
instantaneous frequency of the output signal is varying, too. Using 
Eq. (9.66) and taking advantage of the method for finding 
instantaneous frequency values set forth in Chap. 5, we get 


d n 
Q (t) = Ores + ar arg Vout (t) 


" d tan sin dot (9.68) 
= arc f 
TM dt cos 8ot — exp( — t/Tckt) 





Naturally, at t— co, when the transients in the amplifie have 
practically died out, the frequency of the output signal becomes 
equal to the frequency of the excitation. 

Response of a tuned amplifier to a phase-shift-keyed (PSK) drive. 
As already noted, communication services frequently use truncated 
harmonic waves whose initial phase undergoes abrupt changes at 
discrete instants. This form of modulation is known as phase-shift 
keying (PSK), and the corresponding signals are referred to as PSK 
signals. 

Let us take a closer look at the response of a single-stage tuned 
amplifier to PSK signals, assuming that the excitation experiences 
a change of phase by Ọọ radians at t= 0: 


COS Orest for £«0 


9.69 
COS (Orest + Po) for t» 0 iic 


Vin (t) = Vin l 


The complex envelope corresponding to the above signal is 
Vin (t) = Vm [o (— 1) + exp Goo ()] (9.70) 
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Using the Duhamel superposition integral, we find the complex 
envelope of the output signal: 
F vu Kres Vin . S 
Vout (t) = ——— f [o(— 9 expo o ()] 
Tckt — o 
x exp[ — (t — tte] dt (9.71) 
For t «0, it follows from Eq. (9.71) that 
ry E Kies Vin : 
Vout (t)= —— —— f exp[—(t-1)/texr]Jdt= —Kres¥n (9.72) 
Vckt — o0 
which implies that prior to the jump in phase the amplifier is in 
a steady state. On the other hand, for t>0 
A Kia Vn | 
Vout(t)= ————" f exp[- (t — 0)/text] dt 
Tekt — —oo 
Kres Vn exp (j : 
= Ed em (t j T)/tekt] dt 
Tekt 0 
= — Kres Vn texp( = t/Tckt) 
+ exp (Jo) [1 — exp( — t/tcxs)]} (9.73) 
It is to be noted that for t=0 Eqs. (9.72) and (9.73) yield the 
same result: 
Vout (0) = Kres Vin 
If, however, t/tcki» 1, then 
Vout(t) X — Kres Vnexp Uo) 
that is, when all transients have died out the system goes into 
a new steady state which differs from the previous one by a phase 
shift of ọọ radians. 
From Eq. (9.73) we may write the following expression for the 
physical envelope of the output signal for t>0: 
Vout (t) = Kres Vin {[e ~ Fete +(l—e Siten) cos Po]? 
+ (1 — e7 hung) (9.74) 
In practical PSK, use is often made of a phase shift of 180°. Then 
Vout (t) = Kres Vm | 2 exp ( — t/vckt) — 1| (9.75) PSK with a phase 


Here the amplitude of the output signal goes to zero at time tọ 
which is the root of the equation 
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2 exp ( — to/tcki) — 1 = 0 binary-coded messages 
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Vout /(K res Vm) 


0.25 


t/Tokt 
0 0.5 1.0 1.5 2.0 25 


Fig. 9.10 Signal envelope at the output of a tuned amplifier driven by 
a phase-shift-keyed signal: (1) for og = 180°; (2) for P, =90° 


Hence, 
to = 0.693 Tckt (9.76) 


The dependence of the physical envelope of the output signal on 
the dimensionless parameter t/tcxt for two values of the phase shift 
9o, 180° and 90°, is shown in Fig. 9.10. 

The physical behaviour of the output signal is due to the 
interference of the free and forced oscillations. 

It is to be noted that the transients arising in an amplifier in 
response to a PSK signal are accompanied by variations in the 
instantaneous frequency. On the basis of Eq. (9.73) 


-ff : 
(1— e "sin po 
e Twp (1— e cos oo 








d 
a(t) = Ores + di arctan (9.77) 


Response of a resonant system to an angle-modulated signal. An 
exact solution for the response of a narrowband frequency-selective 
network to an FM or a PM excitation is difficult to obtain. The Lf. 
equivalent method set forth in this chapter only permits us to for- 
mulate the problem. Thus, if the input to a single-stage tuned 
amplifier is a simple single-tone angle-modulated wave 
vin (t) = Va cos (Got + msin Qt) 
whose complex envelope is 
Vig (t) = Vin exp (jm sin Ot) 
then the complex envelope of the output signal can be described by 
the following Duhamel superposition integral 

= Kres Vin 
Tkt 


Vout (t) = J exp(jmsin Qt)exp[ — (t — t)/tekt]dt — (9.78) 
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(It is assumed that @ọ Ores.) Since the integral in (9.78) has 
a varying upper limit, it cannot be evaluated exactly. The problem 
can be solved approximately, if we assume that the instanteneous 
frequency of the input wave varies so slowly that the oscillatory 
system can "follow" its variations. Then the envelope of the output 
signal will be proportional to the magnitude response at the 
instantaneous frequency: 


Kres 


K (jo)! = — 
| il y 1+ Tekt(@ = Ores)? 


On inserting © = Ores + MOQ cos Qt, we obtain the following equation 
for the envelope of the output signal: 


(9.79) 


Kres Vm 


Vout (t) = ———————————— 
meth V 1 + (MOTekt) cos’ Qt 


(9.80) 





Thus, the passage of an FM or a PM signal through 
a carrier-tuned resonant amplifier is accompanied by a parasitic 
amplitude modulation. If mOtx:<«1, then the following 
approximate expression stems from (9.80): 


1 
Vout Hz Kees Vin [1 = 7 (MOtekt) cos? Qt] 


Q c 2 2 
= Kres Vn f: ," rau |- E cos 20} (9.81) 





It means that the envelope' spectrum includes the second harmonic 
of the modulating frequency and, if the frequency deviation is large 
enough, also the higher even harmonics. 

The instantaneous-frequency method permits us not only to 
analyse variations in the amplitude of FM and PM signals, but also 
to find the variations caused in the signal by the oscillatory system 
of the amplifier itself. To this end, we note that the total phase of 
the output signal is the sum of that of the input signal 


Yin = Oot + msin Qt 
and the phase shift due to the phase response of the amplifier: 
Ox(@)= — arc tan (© — Ores) Tokt (9.82) 


On inserting the instantaneous frequency of the input wave 
Oin = Gres + MO cos Ot 


in Eq. (9.82), we get the total phase Wout and the corresponding 
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instantaneous frequency Oout of the output signal: 
Fout = Oot + msin Ot — arc tan (MOTekt cos Qt) (9.83) 


mg Q? sin Qt 
1 + (mQx cos Qt)? 





Oout = FP out/dt = @ + MO cos Ot + (9.84) 


Now we assume that the product of the frequency deviation by 
the tuned-circuit time constant b = mOt.,;«1 and expand the last 
term on the right-hand side of (9.84) into a power series. On 
retaining the first term of the series, we obtain 


Wout = Gg + MO cos Qt + Ob sin Ot — Qh? sin Qt cos?Ot 
By simple trigonometry, we finally get 


Wout = Op + MO cos Qt + Qb(1 — b?/4)sin Ot — (Qb?/4)sin 3Ot (9.85) 


As follows from Eq. (9.85), the instantaneous frequency of the 
output signal contains not only the in-phase component mQcos Qt 
which is present in the input signal, but also a small quadrature 
component which is proportional to sinQt. From its presence we 
conclude that the signal embedded in the instantaneous frequency 
has been shifted in time. In fact, the above equation includes one 
more component which varies at three times the modulating fre- 
quency. It is a manifestation of the distorting effect that 
a narrowband network has on the useful message embedded in the 
current values of the instantaneous frequency. Fortunately, under 
the assumptions that we have made this detrimental effect is 
negligible. 

The role of the phase characteristic of a network. Before we 
conclude our overview of the properties and characteristics of linear 
stationary networks, it is important to see how the phase response 
of a system affects its output signal. 

For better insight into the fundamental aspects of the phenomena 
involved, let us consider a case where the excitation is the sum of 
two harmonic waves. Each has an amplitude of unity, and their fre- 
quencies, o, and @,, are chosen such that their difference is small: 


lo; —@2|/@, «1 
Analytically, the input signal may be written as 
0,—0 0, +o 
Vin (t) = cos œ; t + cos@,t = 2cos ( —— t Jes [o r) (9.86) 
The energy of the aggregate process is concentrated in time as 


individual “portions” called narrowband or quasiharmonic groups. 
The smaller the difference in frequency between the two input 
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waves, the more these groups are extended in time. The low-fre- 
quency term, 2cos Sire.) in Eq. (9.86) is the group envelope. 


A narrowband group may be looked upon as one of the simplest 
elements that make up a wave having a more complicated spectral 
structure. 

Let the signal defined in (9.86) be applied to a linear stationary 
system whose frequency response is 


K (je) = | K Go) | exp [ox (9)] (9.87) 


Suppose that within the frequency interval (@,, w,) the magnitude 
of the frequency response is a constant, Kọ. Then 


Vout (t) & Ko (cos [ot + ex (@;)] + cos [o5t + Px (w2)]} (9.88) 


The phase response of the system can be expanded into a Taylor 
series about the point o,: 


dox 
"de 2 = 0) d us 
Retaining only the linear term of the expansion, we get 
Vout (t) X Ko (cos [@,t + ok (0,)] + cos [o,t + Aot 


dx 
do Aol} 


9x (@2) = ox (©) + 





+ @x (1) + 


[ Aw 


= une | "^ ( + ox ) cos [o,t + 5 Aot 





1 d 
+ ex (0) - — AK Ao] 


Here, Aw =@,—@,. It immediately follows that the envelope of 
a quasiharmonic group at the output of the system is shifted in 
time from the envelope of the input signal by an amount equal to 
| dp k/do |. If this derivative is negative, the envelope of the output 
signal is delayed by a time 


Te= —dexido (9.89) 
called the group (or envelope) delay time. The derivative must be 
taken at an arbitrary point within the frequency interval where the 
bulk of the energy of the narrowband signal is concentrated. 

The group (or envelope) delay time is a convenient measure of 
the delay that narrowband signals experience on passing through 
sluggish linear circuits. 


e 
Solve Problem 11 


e 
Group (or envelope) 
delay time 
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Example 9.7. A rectangular r.f. pulse of duration tp = 20 us and in 


with a carrier frequency fy = 10 MHz is applied to a carrier-tuned 
single-stage resonant amplifier. The equivalent Q-factor of the tuned 


circuit is Qeq = 40. Find the delay time of the output pulse relative to 


the input wave. 
The spectrum of the input signal is concentrated in the frequency 


interval (fy — 1/tp, fo + 1/1), that is, between 9.950 and 10.050 MHz 
(the spectrum width is taken between the zeros of the main lobe of 
the spectrum diagram) The bandwidth of the amplifier is 

BW, 707 = fres/Qeq = 250 kHz 


Approximately, it may be taken that the input pulse in our case is 
a narrowband signal whose delay time may be evaluated by Eq. 
(9.89). Using the equation of the phase response 





Vout 


©x(®) = —arc tan tckt(@ — Ores) 


we get 


Tg lo c, = Tekt = 2Qeq/Mres = 1.27 us 





Summary 


~ 


$33 3 $B 


$ 


$ 


A salient property of narrowband frequency-selective systems is the fact that for them 
the ratio of the bandwidth to the centre (midband) frequency is small. These networks 
are used for the frequency filtering of band-limited signals. 

Physically, frequency-selective networks can be realized as high-Q resonant circuits, 
both single- and multistage. 

The input signal will be broadband with respect to a frequency-selective system if its 
spectrum may be considered constant over the pass band. 

The low-frequency equivalent of a narrowband network is an imaginary system whose 
frequency response is obtained by translating the frequency response of the original 
network into the neighbourhood of the zero frequency. 

The impulse response of a narrowband network is a narrowband wave whose 
instantaneous frequency is close to the central frequency of the passband. 

The complex envelope of the impulse response of a narrowband network is 
proportional to the impulse response of the low-frequency equivalent. 
Frequency-selective networks can be utilized for experimental spectrum analysis in 
which the response of a frequency-selective network to an arbitrary broadband 
excitation is measured in order to trace the frequency dependence of the signal 
spectrum. 

Instead of seeking a complete solution defining the response of a frequency-selective 
network to a narrowband signal, it will suffice to tackle a simpler problem in which 
one determines the response of the low-frequency equivalent of the original network 
to the complex envelope of the input signal. 

If the central frequency of the passband and the carrier frequency are the same, 


$8 3 8 


$ 


Ch. 9 Response of Frequency-Selective Systems to Deterministic Signals 287 


a narrowband network will reduce the modulation depth of an AM input signal. 
When a single-stage tuned system is driven by a truncated sinewave, the envelope of 
the output process rises to 90% of its final (steady-state) value in a time 1, = 
= 4.606 Qeq/Wres. 

If there is a difference between the resonant frequency of a tuned circuit and the 
carrier frequency of the driving pulse, the envelope of the output signal will vary 
nonmonotonically in time. The instantaneous frequency at the output will vary, too. 
The passage of a PSK signal through of a narrowband tuned amplifier produces time 
variations in both the envelope and the instantaneous frequency of the output signal. 
In an elementary form, the response of narrowband networks to FM and PM inputs 
can be determined only on the assumption that the product of the input frequency 
deviation by the system time constant is sufficiently small (the instantaneous-frequency 
method). 

A frequency-selective network is responsible for spurious amplitude modulation of 
FM and PM output signals, and also for the appearance of the 3rd harmonic of the 
modulating frequency in the instantaneous frequency spectrum. 


Review Questions 


1. 
2. 
3. 


4. 
. Plot a typical location of the transfer-function poles of a narrowband system in 


What is the convention for defining the bandwidth of narrowband electric networks? 
What is the attenuation, in decibels, of the signal at the boundary of the bandwidth? 
What is the condition for the amplitude response of a single-stage resonant system to be 
symmetrical about the resonant frequency? 

What is the typical order of magnitude for L, C and Rres in parallel resonant circuits 
with a resonant frequency of several tens of megahertz? 

Define absolute, relative and generalized detuning. 


a complex plane. Can the plot be used to find the Q-factor of the system? 


. What is the tapping-down of a tuned circuit? List the salient features of a tapped tuned 


circuit. 


. How does the internal resistance of an electron device affect the behaviour of 


a small-signal tuned amplifier? How can one mitigate the resultant detrimental effect? 
Write equations for finding (1) the gain at resonance and (2) the bandwidth of the 
amplifier. 


. What is the advantage of a coupled-circuit amplifier over a single-stage tuned amplifier? 
. List the factors which can, in your opinion, determine the upper frequency limit at 


which a tuned amplifier is still operable. 


. What is the meaning, absolute or relative, of the concept of broadband signal? 
. Is it necessary for the low-frequency equivalent of a narrowband system to be 


a physically realizable network? 


. Construct an approximate plot for the impulse response of a narrowband system. Note 


the condition for physical realizability. 


. What is the time constant of a resonant circuit? 
. What is the difference between the impulse responses of a single-stage and a two-stage 


amplifier? 


. Define the physical meaning of the spectral expansion of a signal. 
. How should the bandwidth of a tuned amplifier be chosen so that AM signals can be 


IT: 
18. 
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satisfactorily passed in practice? Where do the requirements for the shape of the 
amplitude response of frequency filter come in conflict? 

What factors decide the rise time of a single-stage tuned amplifier? 

Explain in physical terms the rise of the output of a single-stage tuned amplifier to its 
steady-state value when the amplifier is driven by a truncated voltage sinewave. What is 
the role played by the free (transient) response of the amplifier? Why is it that initially 
the output signal is small? 


. Do the same for a PSK input signal. Why is it that the output frequency does not 


remain constant during transients? 


20. Define the rationale of the instantaneous-frequency method. 
21. Construct an approximate plot of the wanted signal that can be extracted from the out- 
put wave of a single-stage resonant system, assuming that the input signal is 


a single-tone FM signal. 


22. Define the group (envelope) delay time. What should the phase response of a system be 
like for the applied signal to suffer a minimum of distortion? 


Problems 
1. Define the value of generalized 
detuning for which the slope of the 


amplitude response of a resonant circuit is 
a maximum. 

2. A parallel resonant circuit has 
a resistance of 30 kQ at the resonant fre- 
quency of 20 MHz, while the magnitude of 
its impedance at a frequency of 21 MHz is 
18 kQ. Find the element values of the tuned 
circuit. 

3. Find the frequency response and the 
impulse response of the low-frequency 
equivalent of an ideal bandpass filter. Hint: 
see Fq. (9.23). 

4. Work the previous problem as applied 
to a Gaussian radio filter. Hint: See Eq. 
(9.24). 

5. In the small-signal tuned amplifier of 
Fig. 9.3, the tapping-down factor for the 
tuned circuit in the collector lead of the 
transistor can be varied by shifting the tap 
along the tuned-circuit coil. Find the 
relation between the voltage across the 
tuned-circuit capacitor and the 
tapping-down factor. 

6. A Gaussian radio filter [see Eq. (9.24)], 
for which Ky=10, @) =10°s~! and b= 


=5 x 107 '°s?, is driven by a rectangular 
video pulse of 25 V amplitude and 0.2 ps 
duration. Verify that for the filter in 
question the input signal may be classed as 
broadband. 

7. A single-stage tuned amplifier, for 
which fres = 6 MHz, Qeq = 40 and Kres = 35, 
is driven by an exponential video pulse of 
voltage (V) 


Vin (f) = 0.3exp(— 4 x 107A) a(t) 


Find the output signal of the amplifier. 
8. A series resonant circuit is driven by 
a source of emf (V) 


vin(t)= 5 x (1 +0.8cos4 x 10? t)cos 106 t 


The resonant circuit is tuned to resonate at 
the carrier frequency. Find the Q-factor of 
the tuned circuit at which the current 
modulation factor is 0.4. 

9. Analyse distortions in the envelope of 
rectangular radio pulses on passing through 
a single-stage tuned amplifier in which the 
tuned circuit has Qeq = 60. The carrier fre- 
quency (2 MHz) of the input signal is the 
same as the resonant frequency of the tuned 
circuit. 
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10. Define the law of time variations in 
the instantaneous frequency of the output 
signal from a single-stage tuned amplifier 
driven by a voltage wave 


vin (t) = Vo cos (211061 + 0.1 cos 271072) 


The amplifier tuned circuit is tuned to the 
carrier frequency of the input signal and has 
a time constant of 10 ^? s. 

11. A tuned amplifier has two stages 
tuned to the same frequency of 12 MHz. 
The Q-factor of the tuned circuit in the Ist 
stage is 40, and that in the 2nd stage is 50. 
Find the group (envelope) delay time for 
a narrowband signal whose centre frequency 
is 12.2 MHz. 


Advanced Problems 


12. Find the response of a tuned amplifier 
to a single-tone AM signal when the carrier 
frequency o differs from the resonant fre- 
quency Gres of the tuned circuit. Show that 
the difference between the two frequencies 
leads to a parasitic angle modulation of the 
output signal Assuming that the relative 


detuning, | G5 — Ores |/Og, is small, derive an 
equation for the parameters of the parasitic 
modulation. 

13. Investigate the response of a single- 
stage amplifier to an excitation whose 
instantaneous frequency undergoes a step 
change at t— 0: 


mf Vo cos @ot for t «0 
- Vocos(@, + 60)t for t>0 


Assume that @res = @). Find the expression 
describing variations in the envelope and 
instantaneous frequency of the output signal. 

14. Suppose a tuned amplifier consists of 
identical stages. Derive the equation defining 
the rise time of the system as a function of 
the number N of stages, stage time constant 
Tckt, and resonant frequency @res. The input 
signal is a truncated voltage sinewave at fre- 
quency Og = Ores. Hint: Take advantage of 
the fact that 


N-1 


l aif (at)" 
p(p-a aN Cp an m! 


m-0 





Chapter 10 


Response of Linear Stationary 
Networks to Random Signals 


In the previous two chapters, we dealt with methods which 
permit solving any problems involving the passage of deterministic 
signals through linear stationary systems. The final step in the 
theory of linear systems is to extend the above methods to random 
signals. 

Suppose that we have a linear stationary network driven by 
a wave x(t) which is a realization of a random process X (t). If this 
realization is specified in advance, no new problem will arise ^ the 
signal x(t) may be treated as a sufficiently deterministic function, 
although it may be described in a fairly complicated manner. Once 
we know the mathematical model of a system, which may be 
defined in terms of, say, the frequency response K(jo) we can 
always find the system's response y(t). 

A salient feature of statistical communication theory is, however, 
the fact that so full an information about the input signal is not 
available ^ instead of a deterministic description of the input signal 
we have to be content with the statistical averages of the random 
process X(t). These statistical averages are the univariate and 
bivariate probability densities and various moment functions, above 
all the expectation and the autocorrelation function of the random 
process. Our objective is to investigate the association between the 
processes X (t) and Y(t) that can be defined on the basis of the fre- 
quency response of the system involved. 


10.1 Spectral Analysis of the Response of Linear 
Stationary Circuits to Random Signals 


From the outset it is essential to impose an important 
constraint- we shall deal solely with wide-sense stationary input 
processes X (t). As will be recalled, this implies that the expectation 
(mean) of the instantaneous values of realizations, x, is 
time-invariant, whereas the autocorrelation function K,(t,,f,)= 
= x(t,)x(t;) — X? depends solely on t=|t,—t,|, the absolute 
difference between observation times (points on the time axis) 

To simplify matters in our subsequent discussion, we shall always 
put x —0. This will not limit the generality of reasoning and 
conclusions. Owing to the linearity of the circuits in question, the 
effect of the constant (d.c. component in the input signal on the 
response of a system can be analysed independently and, 
importantly, without recourse to statistical procedures. 

The mean of the output signal Let us take an individual 


Ch. 10 Response of Linear Stationary Networks to Random Signals 291 


realization x(t) of the input signal and represent it as a Fourier 
integral 


1 
x()-5- | Selorexp don do 


Here and elsewhere the realization is assumed to be such that its 
spectrum does exist, at least in the form of a generalized function. 

The output signal of the system can be found, if we know its fre- 
quency response 


»0- | Sx(o) K (o) exp (jot) do (10.1) 


When changing from an individual realization to a complete 
ensemble of input signals, we should take S,(@) as a random 
function and recall that the assumption of stationarity (see Chap. 7) 
of the process X (t) imposes rigorous conditions: The mean of the 
spectrum is equal to zero, S,(@)=0. Therefore, on averaging 
statistically both sides of Eq. (10.1), we get 








x 


y= x | S,(@) K (ja) exp (jot) do = 0 (10.2) 


-x 





The autocorrelation function and the power spectrum of 
a random output signal. In order to find the autocorrelation 
function K,(t), we should, in addition to the spectral expansion 
(10.1), also have an expression for the output signal at the time t + 
+t. It can be found on the basis of the properties of the Fourier 
transform: 


: : 
y(t+t)= p | Sx(o) K (jo’) exp (jw’t) exp (jo't) da’ (10.3) 
T 


There is a small (and, indeed, an unimportant) point related to the 
computational technique: the function y(t) is real, and so Eq. (10.3) 
will remain unaffected if we pass to complex-conjugate quantities 
on its right-hand side: 

l 
y(t+1)= = | S*(o’) K* (jo')exp( — jo’t) exp ( — ja’t) da’ 


-x 


(10.4) 


The autocorrelation function of the output signal can now be 


Averaging is done over 
an ensemble of reali- 
zations 
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The filtering property 
of the delta function 
is utilized 


m 

Relation between the 
input and output power 
spectra of a system 


Part Two. Circuits 


found by multiplying together the signals defined by Eqs. (10.1) and 
(10.4) and averaging the product statistically: 


ses f a 
K,(t)= y(Qy(t + 1) = al | Sxl) Sf (o) K (jo) K * (jo) 


x exp( — jo'x)exp [j (o — œ’) t] do do' (10.5) 


At first glance the above equation may seem hopelessly complicated 
to be analysed. But it should be borne in mind that the input 
random process in question is stationary, and so (see Chap. 7) the 
random spectra of its individual realizations are delta-correlated, 
that is, 


Sx(9) SX(o) = 2rW (e) 6(o — e) (10.6) 


where W;(c) is the power spectrum (or the power spectral density) 
of the stationary random process X (t). From this remarkable fea- 
ture in the structure of the input signal spectrum, we can readily see 
the simple meaning of Eq. (10.5): 


1 
Ky(t)= o | W x(w)| K (o) |? exp ( — jot) do 


or equally 





i x 
K,(t) = = | W,.(@)| K (jw) |? exp (fat) do (10.7) 


In effect, Eq. (10.7) contains a complete solution to our problem in 
terms of correlation theory: The power spectrum of a random output 
signal is related to that of the associated input signal as follows: 


W,(@) = W,(@)| K (o) |? (10.8) 


In applied problems, one has often to deal with one-sided power 
spectra, Fx(f) and F,(f), which are defined solely for positive fre- 
quencies f in hertz. Obviously, 


F,(f) = FAIK G2nf)]? (10.9) 


and so the variance of the output signal 


o? = K,(0)= f F AIKU)? df (10.10) 
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is the result of combining the contributions from the power spectrum 
of the input signal multiplied by the frequency-dependent square of the 
magnitude of the frequency response, that is, by the power transfer 
function. 

The manner in which to handle the problems falling in the class 
examined here is already well known to us-it involves the 
evaluation of Fourier integrals by a variety of techniques. Therefore 
in the examples that follow we shall concentrate not so much on the 
mathematical aspect of the matter, as on the physical features of the 
processes concerned. 
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Example 10.1. The response of an integrating RC-network to white 
noise. 

Suppose that a first-order dynamic system schematically depicted as 
an integrating RC-network, is driven by a source of noise emf whose 
power spectrum W,(V? s) is constant at all frequencies. Find the 
variance and the autocorrelation function of the output voltage y(t). 

To begin with, we find the power transfer function of the network 
in question: 


1 


. 2 
IK Go) — T a (ROP 


Now, on setting 1 — 0 and using Eq. (10.7), we find the variance of 
the output noise: 


ge W,/2RC (10.11) 
ofj = —— | —— a = | 
"ox Jr£o'(RCOY T 
= 0 
As should be expected, the variance of the output signal decreases 
with increasing time constant of the network, because this entails 
a reduction in the band of frequencies effectively passed by the 
network. 


The autocorrelation function of the output signal is 


W exp (jox)do 
K,()- 7 | pion) (10.12) 





1 +«@?(RC)? 


Here, 


w 


f exp (jot)do f cosatda 


1+ o? (RC 1+ o? (RCY? 


-0 0 


The last integral is tabulated [40], so taking advantage of the fact, 


bo 
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we obtain 
; W, —|t| 
K,(t) = JRC exp xc] (10.13) 





Naturally, at zero-crossings the autocorrelation function is equal to 
the variance of the output signal. 

To sum up, when an integrating RC-network is excited by white 
noise, the response is a random process having an exponential 
autocorrelation function. 

Importantly, since it is sluggish in response, the RC-network 
effects a kind of *ordering": Whereas the input signal is absolutely 
unpredictable because it is white noise, the output signal is 
smoothed; its correlation time is of the same order of magnitude as 
the time constant of the network. 

Example 10.2. T'he response of a single-stage tuned amplifier to 
white noise. 

Suppose that a small-signal tuned amplifier is driven by 
a source of white-noise voltage having the one-sided power 
spectrum F,(V? Hz‘). The frequency response of the system is 


= K res 
1 +j2ntckt(f — fres) 


and the power transfer function is 





K (2nf) = 


Kies 
| K (j2nf) |? = ———ÀÀ 5 ———4 
1+ 4n tea (f — fres) 


Finding the variance reduces to evaluating the integral in 
(10.10): 


x 


oF = rts | 


0 


df 
i+ An tine(f — fies 





Now we change the variable,  — f — fres and assume that the 
tuned circuit of the amplifier has so high a Q-factor that the 
frequency response for f=0 may be taken equal to zero. 
Then, 


x 


i 2 dn 
iiki [coser n Poeno (10.14) 


- (e 


Ky 
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Finally, the autocorrelation function of the output signal is 


FoyKs&s[ cos ot do 


2n 14+ tàa(o — Ores)? 
0 





K,()- 


7 FoK ĉes f cos (Q + Ores) x dO 
^ ^ 2n 1+ Tikt? 


- i 








f cos Qt dO 


= FoKies 
J 14 130? 


COS Orest 


2 





= 9-75 exp( — |x|/tck) COS Wrest (10.15) 
2tckt 
As is seen, the autocorrelation function thus obtained has the 
form 
K,(t) = o2p(1) cos @yest (10.16) 


which is typical of a narrowband random process, because the 
envelope p(t) -exp(— |t|/vi) is a slowly varying function in 
comparison with the h.f. carrier. 

Any realization of the random process at the output of 
V | a narrowband amplifier is a quasiharmonic wave with a random 
envelope and a random instantaneous frequency; on the average, 
the carrier frequency is equal to the resonant frequency of the tuned 
circuit. This behaviour of the output signal can readily be 
understood if we note that the signal results from combining a huge 
number of elementary responses each of which is proportional to 
the impulse response of the system (the Duhamel superposition 


A typical realization 
of a random signal at 
the output of a tuned 


amplifier : ier 
integral principle). 

In order to get an idea about the order of magnitudes involved in 
statistical communication, let us estimate the variance of noise at 
the output of a tuned amplifier under the following conditions: 

A Fo =107 16 V? Ha +. Kres = 30, Ores = 10° s~ +, and Qeg = 60. The 
Solve Problem 4 time constant of the tuned circuit is Tekt = 2Qeq/Ores = 1.2 us. 


Therefore, on the basis of Eq. (10.14), 
602 210 -!$x 900/(1.2 x 1079) 2 715 x 107 * V? 


The rms value of noise voltage, equal to the square root of the 
variance, is 274 pV. 

Example 10.3. Consider a network composed of two RC-sections 
between which an ideal amplifier of gain Kọ is interposed: 
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Let the system be excited by a source of noise emf having a power 
spectrum constant at all frequencies (white noise). Find the 
autocorrelation function of the output signal. 

The power transfer function is 


| K (jo) |? = Es 
, — (1 + o?c2) (1 + o?) 
In accordance with Eq. (10.7), finding the autocorrelation function 
for the output voltage reduces to evaluating the integral: 
W,K2 rf exp (jox) dw 
Ky) e a id 
2n (1 + œt) (1 + w?13) 

It is advisable to resort to the theory of residues and to take the 
same route as was used in Chap.8 in analysing the impulse 
response of an RC-network. The integrand function in (10.17) has 
four simple poles at points o, ; = +j(1/t,) and $44 = +j(1/t). 

We will evaluate the function Ky(t) for t>0 by closing the 
contour of integration in the upper half-plane. The residue of the 
integrand function at point œ; is 


exp (jox) 5 7, exp( — t/1,) 
2j (tj — tå) 





(10.17) 





res lo- 0, = 
= [( + œt?) (1 + ©713)] | o=o, 


In a similar way, we find the residue for point œ — 0, lying 
within the contour of integration 


— 15 exp( — t/1;) 
2j (ti — 12) 
Hence, by virtue of Cauchy's residue theorem, we obtain 


2 


W,K 
K,(t)= zug exp( — 1/1,) — z; exp( — 1/1)] (10.18) 


res |o- o; = 


for t>0. 

We can obtain the autocorrelation function for x «0 from the 
same equation on replacing t with — t. This stems from the fact 
that the autocorrelation function is an even function. However, the 
result can be confirmed by direct calculation, if we close the path of 
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integration with an arc of an infinite radius in the lower half of the 
complex o-plane. 








Thus, 
A W,K2 
Solve Problem 6 Kya) = Un exp(— 11/5) - t2exp(— [t]/t2)] (10.19) 
2 (ti — 32) 
The variance of the output signal is 
" W,.K2 
6; = K,(0)=——" (10.20) 
2(t, t 15) 
The white noise trans- . : A 
formed by one RC- Therefore, the correlation coefficient is 
network 
1 
R,(1)= Pr exp( — |t|/t,) — t exp(— |t|/t2)] (10.21) 
1 2 


M ANAM: 


Vw W \ The results obtained by Eq. (10.21) for two values of the ratio 
1,/1, are plotted in Fig. 10.1. For comparison, the same figure 
shows a curve which represents the correlation coefficient of 
a random process at the output of a single integrating RC-network 
P be [^ with time constant 1,. It is interesting to note not only the increase 
! in the correlation time due to the addition of a second time-lag 
x J element, but also the changed behaviour of R,(t) for the 
and by two RC-net- tWo-section filter in the vicinity of point 1 — 0. The fact that the 
works connected in  82utocorrelation function has a second derivative at that point 
series assures the differentiability of the output random process (see 
Chap. 7) Physically, the differentiability of the output signal 
implies the smoothness of the realizations of the signal that has 
passed through two RC-networks connected in cascade. 








Single R C-network 





0 1.0 2.0 3.0 


Fig. 10.1 Correlation coefficient for a random process at the output of 
a system consisting of two RC networks: (1) for t, = 1,/2 and (2) for t, = T, 
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Response of a network to broadband random signals. The noise 
bandwidth of a network. Frequently one is concerned with the 
response of linear circuits to very broadband random signals 
formed by, say, a chaotic series of short pulses. In such cases, there 
is every ground for considering the spectral characteristics of the 
noise only within the bandwith of the system, with the real random 
process replaced by an equivalent white noise having a one-sided 
power spectrum Fo = F (fo) where fọ is a point within the 
bandwidth of the network. 

In the circumstances, Eq. (10.10) which defines the variance of the 
response can be simplified as 


o2=F, Í | K (2nf) | df (10.22) 
0 


In engineering calculations, a linear circuit excited by 
a broadband random signal can conveniently be characterized in 
terms of its noise bandwidth, BW, (Hz) It is defined as the 
bandwidth of an ideal bandpass filter whose frequency response is 
K max, that is, equal to the maximum magnitude of the frequency 
response of the real network. When an ideal system is excited by 
white noise with a power spectrum Fp, the variances of the noise 
signals at the output of the ideal and the real networks must be the 
same 








Fo f |K 2nf) |? df= FoKinaxBWn (10.23) 
0 
Hence, 
1 oni 
BW,-—; |K G2nf)|* df (10.24) 
K max 
0 


As an example, for an integrating RC-network: 
Kmax= 1; | K (j2nf)|? = 1/[1 + 4n°f? (RCY] 
Therefore, 


oo 


df 
BW,- 1/4RC 10.25 
ñ Jea unes 








0 

It is to be noted that for the network in question the magnitude 
of the frequency response decreases to 1/|/2 of its maximum value 
at fg 294 = 1/2nRC. Therefore, the noise bandwidth is wider than 


BW, o7: 
BWA&/BW, 707 = 7/2 = 1.571 
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The noise bandwidth of a single-stage tuned amplifier is found in 


a similar way: 


oc 


df 





BW,= PUES 
P Iron orsi 


0 


= 1/2tokt=1.571BWo797 (10.26) 


The example that follows will demonstrate how the concept of 
noise bandwidth can be used in engineering calculations. 


A 
Solve Problem 8 





Example 10.4. A single-stage tuned small-signal amplifier for which 
Kies — 85, Qeq= 70, and fres= 0.7 MHz, is excited by a source of 
stationary noise emf x(t) for which the autocorrelation function (V?) 
is 


K,(t) = 045exp( — BITI) 
where B—107 s^ !. Find the rms noise voltage at the amplifier 
output. 


To begin with, we invoke the W-K theorem in order to find the 
power spectrum of the input signal: 


W,{o)= f Kx(t)exp(—jmt)dt = 20% f exp( — Bt) cos@tdt 
Ed o 


This type of power spectrum has already been found in Chap. 7. 
Taking advantage of that result, we may write for the case on hand: 


Wylo- — 09 x 107/10 + o? 

My ae 9 x 10°/( to) 

The one-sided power spectrum is 
F,.(f) = 2W,(2nf) = 1.8 x 107/[10!* + (2nf?] 

Noting that the power spectrum is a maximum at zero frequency, 
whereas at o = 10’ s ^! it is only half as great, we conclude that 
within the bandwidth of the amplifier the input signal may be 
replaced with an equivalent white noise whose power spectrum is 


Fy = F x(ftes) = 1.508 x 10 7 V? Hz ^! 
The bandwith of the amplifier between the 0.707 points is 
BWo.707 =fres/Qeq = 10 kHz 
The noise bandwidth is 
BW, = (1/2) BW, 797 = 15.708 kHz 


On substituting the numerical values thus found in Eq. (10.23), 
we obtain that 


oF = 1.508 x 1077 x 85? x 15708 = 17.11 V? 
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Hence, the rms value of noise voltage at the amplifier output is 


oy=V1711 =4.14 V 





A 
Solve Problem 5 


Normalization of a random signal at the output of a linear 
stationary network. So far we solved all problems within the 
framework of correlation theory, that is, by invoking at most 
second-order moment functions. More completely the problem 
could be stated like this: The input random process is specified by 
giving a family of its nth-order multivariate probability densities 
Dun(X,. --- Xn; tis ss tn). Given the frequency response K (jo), it is 
required to determine the corresponding probability densities for 
the output process. 

In the general case, the solution of such a problem is a highly 
complicated matter and is not considered in this book. Fortunately, 
however, we may often expect that the output signal will be 
Gaussian, irrespective of the probability density of the input 
process. 

The normalization of the output signal is inherent in any 
stationary linear system if it displays a sufficient time lag (or 
memory). The point is that in accord with the Duhamel 
superposition integral 


y()= f x(t)h(t—1)dt 


the instantaneous value y(t) is the result of the weighted summation 
of the previous values of the input signal x(t), multiplied by the 
time-shifted impulse response (the weighting function) of the 
network. If the duration of the impulse response is such that it 
spans several correlation times of the input random process, the 
conditions for the applicability of the Central Limit Theorem (see 
Chap. 6) are realized. As a consequence, the output signal shows an 
asymptotic normality. If, on the other hand, the input random 
process is normal, the random process at the output of the system 
will be normal, too, irrespective of the dynamic properties of the 
system. 

Thus, the techniques of correlation theory are quite adequate for 
solving most problems involving the response of linear stationary 
circuits to random signals. 


10.2 Sources of Fluctuation Noise 
in Circuit Components 


This closing section of Chapter 10 will be concerned with the 
physical phenomena that stand behind fluctuation voltages and 
currents in circuits. We will also derive the relations that are used 
to assess the intensity of noise. 
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Thermal noise in resistors. The most common cause of noise is 
the fluctuation of the bulk density of electric charge in conducting 
bodies (resistors) in turn brought about by the chaotic thermal 
motion of charge carriers. Although the system as a whole is 
electrically neutral, time-varying electromagnetic fields are produced 
in the bulk of the resistor, and a noise potential difference is 
produced across the external terminals. The noise voltage has an 
extremely wide spectrum because the charge carriers are very 
densely packed and the mean thermal velocity is high. In view of 
this, it is legitimate to think that at radio frequencies the thermal 
noise voltage across a resistor is an approximate realization of 
white (delta-correlated) noise. 

The Nyquist law. Let us derive the relation for the power 
spectrum of the noise voltage between the terminals of a resistor 
R which is in thermal equilibrium with the surroundings at 
absolute temperature T. To this end, we mentally connect the 
resistor in parallel with a capacitor C and replace the real noisy 
resistor with a series combination of an ideal noise-free resistor 
R and an e.m.f. source producing white noise. It is required to 
determine the power spectrum W, of this noise. 

Statistical mechanics tells us that when a system is in thermal 
equilibrium, its thermal energy is so distributed among the degrees 
of freedom that each takes on an average amount equal to kT/2 
(where k=1.38x 10-7? JK ^! is Boltzmanns constant) This 
statement is known as the Law of Equipartition of Energy. Since the 
network we are considering is a first-order dynamic system with 
one degree of freedom, the average electric-field energy stored in the 
capacitor is exactly kT/2, that 1s, 


Cvt[2 = kT/2 s 
and so the variance of the noise voltage across the capacitor is 
o? = vê = kT/C 


Now we will use Eq. (10.11) which relates the variance to the 
power spectrum of the noise voltage. Since 


W,/2RC = kT/C 
the auxiliary quantity C cancels out, and we get 
Wo =2kTR 


Practically, it is more convenient to use the one-sided power 
spectrum defined for the positive frequencies and having the units 
of V? Hz '!: 


Fg —4kTR (10.27) 





The charge in region 
Á is not equal to that 
in region B due to 
the chaotic motion of 
the carriers 
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The best performance 
is achieved when the 
front-end circuits of 
receivers are cooled to 
the liquid-helium tem- 
perature (T= 4.2 K) 





Specific brightness 
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This remarkable relation, known as the Nyquist Law, was proved in 
the late 20s. 

It is to be stressed that Fy has the simple and clear physical 
singificance of the specific variance of the thermal noise source, that 
is, the variance per frequency band of 1 Hz. 

The order of magnitude for the power spectral density of thermal 
noise can be assessed from the following example. For T = 300 K 
and R=10 kQ, F, will be 1.66 x 10716 V? Hz !. Hence, the 
specific rms noise voltage is 1.29 x 1078 V Hz "'?. Although it 
appears very small, thermal noise may well be a decisive factor in 
limiting the actual sensitivity of receivers. 

It is interesting and important to note that the noise power that 
can be transmitted into an external resistive load is independent of 
R. To demonstrate, consider a system in which an ideal filter with 
a passband of 1 Hz is placed between R and RL. As will be recalled 
from circuit theory, the power transferred into load is a maximum 
when R = R, (the matching condition) and is equal in our case to 


Psp = vap/4R = kT(W Hz!) (10.28) 


Accordingly, the only effective way to minimize thermal noise is 
to cool the input circuits of sensitive receivers used in radar, radio 
astronomy and deep-space communications to very low 
temperatures. 

Noise in receiving antennas. In communication equipment an 
important and, sometimes, the decisive source of noise may be 
chaotic fluctuations of electromagnetic fields generating noise 
voltage at the output terminal of a receiving antenna. 

Let an elementary receiving antenna (a Hertzian dipole) of length 
l be oriented along the z-axis and placed inside a closed space 
whose walls are at a temperature T. 

By the Planck law, the closed space is filled with an equilibrium 
electromagnetic radiation characterized by a special spectral 
parameter known as specific brightness and having the units of 
Wm ?Hz ! srad7?: 

3 
B=— 2 (10.29) 
c? [exp (hf/kT) — 1] 





where c is the velocity of light, f is the frequency in Hz, and h= 
= 6.62 x 10-?*^ J Hz~ ! is Planck's constant. Specific brightness is 
a flux of electromagnetic radiation per Hz, incident at a given point 
from within a solid angle of 1 steradian. 

If hf « kT (which is typical of radio frequencies), then Eq. (10.29) 
transforms into an approximate relation known as the 
Rayleigh-Jeans radiation formula 


B -2kT/A? (10.30) 
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where A=c/f is the wavelength. 
Let us include the quantity 


E%p = E3 spt E? sp + E, sp 





which is the mean square of the electric field strength E per Hz. It 
is proved in the theory of electromagnetism that in the 
circumstances the radiation power flux (W m`?) is 


E2p/120n = E2 sp/40n 


The above expression takes into account the fact_that because all 
the spatial directions are equally significant, E%=3E2 sp. By 
dividing the power flux into 4m, that is, by the solid angle of the 
entire space, we obtain an expression for brightness in terms of field 
quantities: 


B = EŻ sp/1607? (10.31) 
On equating the right-hand sides of Eqs. (10.30) and (10.31), we 


find the specific mean square of the electric-field component which 
is oriented along the antenna: 


EŻ sp = 3208 kT/A? (10.32) 





Since the voltage induced across the terminals of the antenna 
(which is short in comparison with the wavelength) is v= El, the 
specific variance of the output voltage is found to be 


và, = 3207? (1/4)? kT (10.33) 


If we introduce the so-called radiation resistance (Q) of a Hertzian 
dipole 


Ry = 80n?(1/A)? . 


then Eq.(10.33) transforms into the Nyquist equation for an 
elementary receiving antenna: 


vip = Fo = 4kTRy (10.34) 


Here T is the temperature of the equilibrium medium through 
which electromagnetic waves are propagated. This fully holds only 
for noise of cosmic origin. As measurements have shown, the 
“coldest” regions of the sky have a temperature of several kelvins. 
On the other hand, the temperature in the direction of radio 
galaxies and other natural sources of radio noise emission may be 
as high as 10000 K. As far as atmospheric interference of terrestrial 
origin is concerned, here the bulk of noise power is concentrated at 
frequencies below 30 MHz. In order to retain Eq. (10.34) unchang- 
ed, one has to introduce the noise temperature T; which is fre- 
quency-dependent. The spectral composition of atmospheric 
interference is such that at frequencies of the order of 1 MHz the 
noise temperature may sometimes be as high as 3x10? K. 


Electric field strength 
has the dimensions 
of V nr! 
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Shot noise derives its 
name from the re- 
semblance that it bears 
to that of fine shot 
falling on a surface. 





icon 


~ 


Pulse overlap 


The above reasoning 
also applies to the 
injection of carriers in 
semiconductor devices 
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Shot noise. In this case, very common in electronic circuits, noise 
is generated due to the passage of discrete charge carriers. In 
contrast to thermal noise, the fluctuations in this case arise not 
from the chaotic thermal motion of electrons, but owing to the 
statistical independence of carrier motions in electron devices 
(tubes, crystal diodes, transistors, etc.). 

As an example, consider a thermionic (hot-cathode) diode in 
which a current is caused to flow by a source of constant e.m.f. 
This current takes the form of a chaotic stream of electrons each of 
which carries a charge e= 1.6 x 10 ^ !? C. The time for the transit 
of an electron from the cathode to the anode is t; % 10 ^? s. During 
this interval, a short pulse of the so-called convection current is 
registered in the external circuits of the diode. The charge thus 
transferred by each electron is the electronic charge e and so: 
T 
ficondt=e 
0 


Hence, we estimate that icon z: 1.6 x 10719 A. 

Ordinarily, the diode current is a few milliamperes, so the pulses 
of convection current densely overlap in time. 

Electrons are emitted by the cathode at statistically independent 
instants. Hence it is clear that the instantaneous value of anode 
current does not remain constant-it experiences certain fluc- 
tuations. In this sense, an electron device acts as a source 
of a special kind of noise which has come to be known as shot 
noise. 

Poisson distribution. Let v designate the average number of 
electrons arriving at the anode every second. Experiments have 
convincingly proved that this numeric characteristic is statistically 
constant, that is, stationary. The d.c. component of anode current is 
connected to the parameter v by a simple relation 


Io = ev 


The number v is very large: for 1; — 1 mA it is estimated to be 
m 1016 s- t. 

Before we analyse the process statistically, we will make 
a simplifying assumption, of minor importance physically, but 
facilitating calculations: Suppose that in their travel from cathode 
to anode electrons follow one another singly, so that the probability 
of electrons arriving at the anode in twos, threes, and so on, is 
negligible. 

From the discrete mechanism of the process, we may legitimately 
consider that if A is the arrival of an electron at the anode in the 
interval (t, t + At), then, to within small terms of the order of (At)?, 
the probability of this event is given by 


P4=vAt (10.35) 
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Let P(t) designate the probability that no one electron will 
arrive at the anode during the time interval from zero to t. Then 
Po (t + At) will be the probability of a complex event: Not a single 
electron will arrive at the anode in either the interval (0, t) or in the 
interval (t, t + At). According to the properties of the probability of 
a compound event, we have 


Pj (t + At) 2 Po (t)(1 — vAt) 


By passing to the limit for At—0, we obtain the differential 
equation 


dP/dt = — vPg 


subject to the obvious initial condition P,(0)— I. The solution of 
the equation is elementary: 


Po(t)= exp( — vt) 


Since v z 1015s ^ !, the probability that not a single electron will 
arrive at the anode during the time interval of 1 s long will be 
exp( — 1019), which may legitimately be taken as the probability of 
an improbable event. 

Let us analyse the probability P,(t) that exactly one electron 
arrives at the anode. In the time interval (0, t + At) this probability 
is the sum of the probabilities of two disjoint events: 

(a) an electron arrives in the interval (0, t); 

(b) an electron arrives in the interval (t, t+ At). 

By the rule for the addition of probabilities, 


P, (t+ At) 2 P,(O(1 — vAt) + Po (t) vAt 

Hence, we obtain the following differential equation: 
dP, /dt= —vP,+vP, 

subject to the initial condition P, (0)=0. 


In a similar way, we obtain a solution for the initial-value 
problem involving the arrival of exactly n electrons at the anode: 


dP/dt = —VPn+VvPn-, (10.36) 
P,(0)=0 


By direct substitution, we find that 


(v) 


- -exp( — vt) (10.37) 


Equation (10.37) defines the Poisson distribution which is 
encountered in many problems of statistical communication theory. 
If an experiment yields a Poisson-distributed whole-numbered 


A complex (or com- 
pound) event is formed 
by two or more inde- 
pendent events 





The Poisson distribu- 
tion 
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variable, variations from the mean in either direction will occur 
rarely on any one trial. 

Moments of a Poisson-distributed random variable. Let us 
choose a time interval T and count the average number of electrons 
arriving at the anode: 


x W 


T n T n~1 
ñT = n WT) exp( — vT)= vTexp( — vT) MP. ewT 
n! (n — 1)! 


n=0 n=1 





(10.38) 


The meaning of the above equation is simple to see: It confirms the 
original supposition that v is the mean arrival rate of electrons. 
Now let us find the mean square of the number of electrons 
arriving during the chosen time interval: 





n! 


= > ha- 1)+n] WT) exp( — vT) 
n=0 





oo LPRA 
=vT+(vT? » gp eC YD T+ (vr (10.39) 
n=2 


Using Eqs. (10.38) and (10.39), we obtain the variance of the 
number of arriving electrons 


of =nt— (ñr? =vT (10.40) 


Statistical properties of the diode current. Now let us determine 
the current flowing through a thermionic diode. If a number n of 
electrons arrives at the anode over a time T, then the current ir 
over the observation interval will be defined by 


ir = en/T 
The mean value of the observed current is 
I, — ir- (e/T)ñr = ev (10.41) 
and the variance of the current is 
of = (e^/T?)a$ = (e/T) 1; (10.42) 


If we choose to measure the intensity of current fluctuations in 
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terms of the -atio of the rms value to the mean value, then 


oi/Is  Ve/TNVI, 


(10.43) 


The conclusion stemming from Eq. (10.43) is this: The relative 
fluctuations of the diode current fall off with an increase in both the 
observation time and the mean current. 
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Example 10.5. Let Ij — 10 ? A and the observation time T — 1 s. 
Then the variance of the current over the observation time is 


of =1.6 x 107?! A? 
and the current through the diode will be 
i=10°74+4x10 UA 


It is seen that the relative fluctuations of current are very small. 
If we substantially reduce both the mean current and the 
observation time by putting I1,=10 5 A and T—10 8s, then 


0221.6x10-!? A? 


and 
i210 344x10-!9 A 


that is, the relative fluctuations of current build up markedly. 
The above example explains why we do not notice the random 
oscillations of the pointer of a moving-coil instrument connected in 
series with a thermionic diode. Here, the current being measured is 
averaged over a time interval of about one second due to the 
sluggishness of the mechanical system of the instrument. 








Schottky's equation. The shorter the observation time T, the 


broader the bandwidth that has to be considered in the spectrum of 
the process. By Kotelnikev's theorem, for a system to be able to 
process a signal over a time T, the system must pass all frequencies 
up to the frequency fmax such that 


T = 1/2fmax 
Taking advantage of thi: in Eq. (10.42), we get 
6? = 2elofmax 
Hence, the specific variance of the fluctuating current, that is, the 
variance per hertz of the frequency band, A? Hz ', is 


1$; — 2el, (10.44) 


In radio engineering, this important relation has come to be known 
as Schottky's equation. Accordng to it, the equivalent noise circuit 
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of any electron device contains a current source producing white 
noise with a power spectrum defined by Eq. (10.44). 

Experiments show that the power spectrum of shot noise in 
electron devices remains flat (that is constant) up to frequencies of 
several hundred megahertz and then begins to decrease with rising 
frequency. This is because at very high frequencies jor, which is the 
same, at small values of T) the adopted noise model, which 
requires a sufficiently large number of electrons to arrive at the 
anode over the observation period, is no longer valid. Also, the 
decrease in the power spectrum of noise due to the finite duration 
of the elementary convection current pulse begins to take effect. 


Example 10.6. A single-stage RC-coupled transistor amplifier has 
the following parameters: Ry — 5.1 KQ, Cp = 45 pF, and R;= 20 kQ. 
The Q-point is located on the transistor characteristic so that the 
direct component of the collector current is Ig = 1.5 mA. Find the rms 
output noise voltage due to the shot effect in the transistor. 

To begin with, we use the Schottky equation to find the power 
spectrum of the noise current source: 


F,—2e1, 22 x 16 x 107? x 1.5 x 107? 
—48x1077A?Hz^! 


In setting up an equivalent output circuit for the amplifier, we 
note that here the system's frequency response is the complex 
impedance placed in parallel with the current source: 


— Ba 

1+j@CpReq 

where Reg= RLRj/(Ry + Ri). In our case, 
Req = 5.1 x 20/25.1 = 4.06 KQ 


Z(jo)- 


The variance of the output noise voltage can be found br 
Eq. (10.22) 


: ^ df 
07 =F, | |Z (2m) |? df= FoR2q | ————————- 
t of (j 5 : 0 f 1+ 4n? RC? 
F Re 
= —— = 1.16 x 1078 V? 
4Cp 


Finally, the rms value of the output noise voltage is 
O= Vo? = 108 uV 
Such calculations have to be performed whenever one s to 


determine the sensitivity limit of small-signal amplifiers. The asual 
procedure is to refer the rms noise voltage to the input by the 
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equation 
Gin = Sout/K 


where K is the gain of the system at the signal frequency. The value 
thus obtained is taken to be the least rms voltage of the useful 
harmonic signal that can be amplified by the device in question: 


Vas = V29in 
In our example where the transconductance of the transistor is 
Qm — 20 mA/V, the gain at the zero frequency is 


K= JmReq = 81.2 


Therefore, 

Cin = 108/81.2 = 1.33 uV 

and the minimum amplitude of the signal that can be amplified is 
min. 133 x |/2 = 1.88 pV 


(It is assumed that the signal frequency is substantially lower than 
the upper frequency limit of the amplifier.) 





Summary 

<*> If the mean vahe of a stationary random signal at the input of a linear system is zero, 
then the mean value of the output signal will also be zero. 

<*> The power spectum of the output random signal is equal to that of the input signal 
multiplied by the square of the magnitude of the frequency response. 

$T An integrating RC-network excited by white noise has an exponential autocorrelation 
function. " 

<> The output signalof a tuned amplifier driven by white noise is a narrowband random 
process. 

$C Ifa linear stationary circuit is sufficiently sluggish, then its output random process is 
asymptotically normal, irrespective of the statistical properties of the input random 
process. 

<*> In resistors, therma noise arises owing to random fluctuations in the electric charge 
density. The therma noise of a resistor has a practically constant power spectrum at 
all frequencies in tle rf. range. 

QC The power spectrum of thermal noise is found by the Nyquist law. 

<*> The equivalent noise temperature of receiving antennas depends on the frequency 
band involved and ringes from several kelvins to millions of kelvins. 

VÒ The shot effect in elecron devices is related to the discrete nature of electron emission 
and statistical indepmdence between the motions of individual charge carriers. 

S The statistical propeties of an electron stream are described by the Poisson 
distribution. 

<> In an equivalent circui, an electron device displaying the shot effect may be replaced 


with a noise current seurce having a uniform spectrum; the power spectrum of the 
current is defined by 3chottky's equation. 
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Review Questions 


1. 


How does the stationarity of the input random process figure in the derivation of the 
equation defining the power spectrum of the output random process? 


2. What is the approximate shape of plots for the autocorrelation functions of random 
signals: (a) at the output of an integrating RC-network; (b) at the output of a single- 
stage tuned amplifier? The excitation is white noise in either case. Are the realizations 
differentiable in the statistical sense? 

3. What are the salient features of the autocorrelation function of the random signal at the 
output of a two-section RC-network excited by white noise? 

4, When may we replace the real process existing at the output of a real circuit with white 
noise? 

5. What is the noise bandwidth of a circuit? 

6. List the physical factors that cause the output signal of a linear circuit to be normalized. 

7. Describe the mechanism by which thermal noise arises in resistors. Define the frequency 
range within which thermal noise may be equated to white noise. 

8. What determines the noise voltage between the terminals of a receiving antenna? 

9. Describe the nature of shot noise in electron devices. 

10. Write the equation defining the Poisson distribution and interpret the physical signi- 
ficance of the parameter v. 

11. What is the equivalent circuit used to represent the noise properties of an electron 
device displaying the shot effect? 

12. How is the power spectrum of shot noise distributed in frequenty? 

Problems 


1. A stationary random process X (t) 
whose power spectrum is 


0, a< -oe 


W.(@) =< Wy — 0c <0 < Oe 

0 0>: 

is applied to the input of an integrating 
RC-network. Find the variance of the out- 
put signal. 

2. Work Problem 1 for the same signal 
applied to the input of the differentiating 
network shown in the accompanying 
diagram: 


X(t) R po 


~ 


3. There is an ideil low-pass filter whose 
frequency response ii 
0 O< -0e 
K (jo) =< Ky, — 0< 0 < 0c 


0, >De 
where @, is its cut-off frequency. It is 
driven by a voltae which is a stationary 


random process whose autocorrelation 
function is 

Kx(1)= oxexp(- a] 1) 

Find the power spectrum, the 


autocorrelation unction and the variance of 
the output voltage. 

4. A series sonant circuit is driven by 
a white noise scurce whose power spectrum 
at all frequendes is W). Determine the 
power spectrun and the autocorrelation 
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function of the output voltage y(t). 


|o 


5. There is a single-stage tuned amplifier 
driven by a voltage source which generates 
Gaussian white noise with a power spectrum 
P230 V^ Be. The amplifier 
parameters are Kyes=100, Q«q— 110, and 
fres = 15 MHz. Find the probability of the 
output noise voltage exceeding 2 mV. 

6. Derive the equation defining the 
power spectrum of the output signal from 
a two-section RC-filter (see Example 10.3) 
driven by a noise voltage whose 
autocorrelation function is 


Kx(1) = otexp( — «| t|) 


7. The resonant circuit shown in the 
accompanying diagram 


has the following paramefers: R =8 Q, L= 
=1.5 uH, and C-—120 pF. It is placed 
inside an enclosure with a temperature T — 
—400 K. Find the variance of the noise 
voltage across the inductor and the noise 
bandwidth of the circuit. 

8. The amplitude response of a low-pass 
filter falls off linearly with rising frequency 
in the interval (0, fe): Find the noise 


Ko 
fu f 
0 


bandwidth of the system. 
9. Determine the noise bandwidth of the 


two-section RC-filter in Example 10.3. 

10. A resistor R=10kQ held at 
a temperature T = 300 K is connected to 
the input of an ideal low-pass filter having 
the following frequency response: 


IKI 
40 


Determine the variance and the 
autocorrelation function of the filter’s output 
signal. 

11. A microwave antenna with a radiation 
resistance of Rz—2.5 Q picks up signals 
from a region in space at a temperature of 
T —20 K. The bandwidth of the system is 
400 MHz. What is the rms noise voltage 
between the terminals of the antenna? 

12. Determine the variance of indications 
by a sluggish instrument measuring the 
current of a thermionic diode. The direct 
component of current is 0.3 mA, and the 


characteristic integration time (time 
constant) of the instrument is 2 s. 
Advanced Problems 

13. A random process X(t) whose 


autocorrelation function is K,(t,, t3) is 
applied to the input of a linear stationary 
system for which the impulse response h(t) 
is known. Using the Duhamel superposition 
integral, show by direct calculation that the 
autocorrelation function of the output signal 
is defined by 


Ky(t,, t2)= J Kx(E;, &3) 


x h(t; — €1)h(t2 — 55) d$,d8; 


that is, it is a two-dimensional convolution 
of Kx(t,, t5) with A(t). 
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14. Investigate the statistical charac- 
teristics of the random current in a system 
where electric-field forces cause a large 
number of minute conducting bodies (such 
as metal dust particles, small pieces of foil, 
and the like) to move between the plates of 
a capacitor. The number of particles moving 
at the same time is assumed sufficiently 
large for statistical analysis to be applicable. 
Determine the variance and power spectrum 
width of the process as functions of the 
system’s physical parameters. Think up 





a way of demonstrating the process. Propose 
its interpretation based on the shot noise 
model. Analyse the effect of the viscosity of 
the medium on the power spectrum width. 


Chapter 11 


Signal Transformations 
in Nonlinear Circuits 


So far we have dealt with linear circuits. A salient feature of any 
linear circuit is that it obeys the principle of superposition. 
A simple and very important conclusion can be derived from that 
principle: On passing through a linear stationary system, 
a harmonic signal remains unchanged in waveform, but acquires 
a different amplitude and a different initial phase. 

But it is precisely for this reason that a linear stationary system is 
not able to enrich the spectral composition of the waves applied to 
its input. This substantially limits the class of useful signal 
transformations that can be performed by constant-parameter linear 
circuits. 

A wider choice in this respect is offered by nonlinear systems 
characterized by the fact that in them the input signal vin(t) and the 
response vow (t) are connected by a nonlinear functional relation of 
the form: 


Vout (t) — f(vin, t) (11.1) 


In this chapter we will examine some general features inherent in 
nonlinear systems, techniques of mathematical analysis, and the 
most important of signal transformations that are performed by 
nonlinear circuits and devices. 


11.1 Lag-Free (Zero-Memory) Nonlinear Transformations 


In the general case, an analysis of a nonlinear circuit is a very 
complex task because in deriving a mathematical description for the 
internal state of the system we inevitably run into the need to 
solve nonlinear differential equations. It is a well-known fact that 
they cannot be solved by the techniques that yield a relatively easy 
solution for linear differential equations with constant coefficients. 
Yet, there are cases where an analysis of a nonlinear system can be 
carried to completion with relatively simple techniques. For this it 
will suffice to require that the nonlinear relation of the form in 
(11.1) should not contain time explicitly. Physically, this requirement 
implies that the nonlinear element involved is free from time lag (or 
has zero memory) In other words, its response instantaneously 
follows any changes in the excitation. 

Strictly speaking, zero-memory nonlinear elements are non- 
existent. However, this idealization is sufficiently accurate, if the 


The condition for a 
transformation to be a 
lag-free (zero-memo- 
ry) one 
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characteristic time of change in the input signal is substantially 
greater than the transient response time of the nonlinear element 
itself. 

With regard to electronic circuits, nonlinear elements are most 
frequently semiconductor diodes and transistors. For their 
operation they depend on the diffusion of minority carriers in the 
regions of a semiconductor material directly adjacent to a P-N 
junction. Present-day semiconductor devices show a very high 
performance in terms of frequency properties. In them, the equilib- 
rium (steady) state can be reached in a matter of 10^ !! s. Therefore, 
the assumption that the internal processes in nonlinear circuit 
components are free from time lag is frequently well justified. 

External characteristics of lag-free (zero-memory) nonlinear 
elements. The functional relation in (11.1) may be looked upon as 
the simplest mathematical model of a nonlinear element. Its 
distinction is that is does not involve any of the internal processes 
occurring in the element. It is customary to say that here we have 
to do with the external characteristic of a system. 

To make matters more specific, the discussion that follows will be 
concerned with the external characteristics of nonlinear 
two-terminal networks (one-ports), assuming that the excitation is 
the voltage v across the one-port, and the response is the current 
i in that same one-port. The relation i(v) is usually called the 
current-voltage characteristic of a nonlinear element. All the techni- 
ques involved and the results thus obtained may be extended to 
include four-terminal networks, or two-ports, such as transistors 
operating in the nonlinear region at large amplitudes of the input 
signal. Here, the output circuit 1s represented as a current source 
controlled by the output voltage; the relation between the 
instantaneous values of voltage and current is substantially 
nonlinear. 

Practical nonlinear elements have a variety of external 
characteristics. For example, there is a class of nonlinear elements 
having univalued current-voltage characteristics (Fig. 11.1a), and 
a class of nonlinear elements whose characteristics include multiva- 
lued regions (Fig. 11.1b). 

The resistance of a nonlinear one-port. With regard to 
a nonlinear one-port the concept of resistance may be defined in 
more than one way. Let i(v) be the current-voltage characteristic. 
On setting v= W, the current in the circuit will be I} = i(V;). The 
ratio 


Rc (11.2) 


is called the d.c. resistance of the element. In contrast to the usual 
resistance of a linear resistor, R= is not constant, but varies with 
the applied voltage. 
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i,mA i, mA 
10 4 
5 2 
v,V | v,V 
0 0.5 1.0 0 0.05 0.1 0.15 02 
(a) (b) 
Fig. 11.1 Typical current-voltage characteristics of nonlinear two-port 


(four-terminal) networks: (a) single-valued characteristic of a crystal diode; 
(b) characteristic of a tunnel diode such that the same current can 
correspond to three different values of voltage 


Frequently, a nonlinear element is driven by two voltage sources 
at the same time, V4 and Av, such that 


| Av|/| v| « 1 


On expanding the current-voltage characteristic into a Taylor series 
about point W, we find the current to be 


ix Ig + i (V9)Av 


The ratio of a change in voltage to the resultant change in 
current at the selected operating point (V5, I5) is called the dynamic 
or incremental resistance of a nonlinear one-port 


Ra = Av/Ai = Vi (V) (11.3) 


. * EH * ` . 
Sometimes it is more convenient to use the dynamic 
transconductance 


gm = 1/Rq = di/dv |, = y, (11.4) 


defined by the slope of the current-voltage characteristic at the 
specified operating point. 

It is to be stressed that the resort to the concept of dynamic 
resistance or dynamic transconductance is in effect the linearization 
of the actual current-voltage characteristic. It is valid solely for 
small increments in the signal about the operating point. 

Description of the characteristic of nonlinear elements. As a rule, 
the current-voltage characteristics of nonlinear elements are 
obtained experimentally; they can be found theoretically far more 
seldom. For an analytic study of the processes occurring in circuits 
containing such elements, it is necessary above all to present the 
current-voltage characteristics in a mathematical form suitable for 
calculations. 

The presentation of a characteristic in tabular 1orm may be 
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a simple and very accurate method. It is especially convenient for 
computer-aided circuit analysis; the argument and the function are 
stored in a computers memory as a two-dimensional array of 
numbers. Any specified accuracy can be obtained by making the 
step of tabulation sufficiently small, and also by using interpolation. 

Where a study is to be conducted by analytic rather than by 
numerical methods, the need arises to choose an approximating 
function which, while being sufficiently simple, could represent all 
the essential features of the characteristic obtained by experiment. 

The forms of approximation most frequently used in 
communication engineering in order to represent nonlinear 
characteristics are discussed in the pages that follow. 

Piecewise-linear approximation. This technique is based on 
replacing a real characteristic curve by straight-line segments 
varying in slope. It is usually employed to analyse processes in 
nonlinear elements in the case of large-amplitude excitations. As an 
example, Fig. 11.2 shows the input characteristic of a real transistor 
approximated with two straight-line segments. 

The approximation is determined by two parameters, namely the 
cut-off voltage V; and the transconductance gm which is the slope of 
the tangent to the curve at the specified points; its dimensions are 
units of conductance. Mathematically this is written as follows: 


ro ae (11.5) 
lop = d 
Woskb s 


The cut-off voltage for the input characteristics of bipolar 
transistors is of the order of 0.2-0.8 V; the transconductance is 
usually around 10 mA/V. When instead of base current the 
dependent variable is collector current, with the base voltage being 
the independent variable, the value of transconductance must be 
multiplied by À;,p, the base current transfer ratio (or gain). Since 
hj,r = 100-200, the transconductance in this case is of the order of 
several amperes per volt. 





0 03 0.6 0.9 


Fig. 11.2 Input characteristic of a transistor connected in 
a common-emitter circuit: base current is plotted as a function of 
base-emitter voltage 
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Power approximation. This form of approximation is based on 
expanding the nonlinear current-voltage characteristic i(v) into 
a Taylor series converging in the vicinity of the operating point Vj: 


i(r) =a, +a (v — V9) - aj (0 — V9 +... (11.6) 


Here the coefficients ao, a,, a5, ... are real numbers. The number of 
terms in the expansion depends on the desired or specified accuracy 
of calculations. 

Power approximation is widely used in the analysis of nonlinear 
devices driven by relatively small excitations. The manner in which 
the coefficients of the power expansion are found will be clear from 
the simple example that follows. 
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The general formula: 








Example 11.1. The experimental input characteristic ig = f(vpr) of 


a transistor is specified by the plot of Fig. 11.3. Find the coefficients 
āo, d,, and a, defining the approximation of the form 


iB = ag + 4; (VBE — V9) + a; (Bg — Vo)? 


in the vicinity of the operating point V, — 0.7 V. 

Let the nodes of the approximation be the points 0.5 V, 0.7 V, 
and 0.9 V. As is seen from the construction, in order to find the 
unknown coefficients, we should solve the following set of 


equations: 
å Ay — 0.2a, + 0.04a, = 0.05 
Solve Problem 1 ay = 0.15 


dy + 0.2a, + 0.04a, = 0.5 


ig,mA 
0.5 P2 
0.15 
0.05 Vee Vv 
0.5 0.7 0.9 


Fig. 11.3 Power approximation of the input characteristic of a transistor 


connected in a common-emitter circuit 


Hence, 


a) = 0.15 mA, a, = 1.125 mA/V, a; = 3.125 ma/V? 


It is to be stressed that power 


approximation gives 
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predominantly a local description of a characteristic. It is not 
advisable to use this technique when the instantaneous value of the 
input signal markedly deviates from the operating point, as the 
accuracy of calculation would then be too low. 





Exponential approximation. From the theory of P-N junctions, 
the following form is established for the current-voltage 
characteristic of a crystal diode for v>0 near the origin 


i(v) = i [exp(v/vr) — 1] (11.7) 


Here ig is the leakage current across the junction, and vy is the 
thermal voltage which is set at 25 mV for silicon devices as 
measured at a standard temperature of 300 K. 

The exponential relation of the form (11.7) is frequently used in 
the study of nonlinear phenomena in electronic circuits containing 
semiconductor devices. The approximation is quite accurate for 
currents not exceeding several milliamperes. For heavier currents the 
exponential curve quietly changes into a straight line owing to the 
effect of the bulk resistance of the semiconductor material. 


11.2 The Spectral Composition of the Current 
in a Zero-Memory Nonlinear Element Driven 
by a Harmonic Excitation 


Consider what happens when a source of harmonic signal voltage 
vs (t) = Vin cos ot 


and a source of d.c. bias voltage V, drive a zero-memory (lag-free) 
nonlinear element. The waveform of the current in the circuit can 
be found by taking advantage of the simple graphic construction in 
Fig. 11.4. 








Fig. 11.4 Construction of a curve representing variations in the current in 
a lag-free nonlinear circuit 
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It is easy to see that the current and the voltage differ in 
waveform. The cause of distortion in the current waveform is very 
simple: Equal changes in the voltage bring about unequal changes in 
the current because 


Ai= ga(v) Av 


Also, the dynamic transconductance is likewise different within 


different portions of the curve. 
The basic principle. If we approach the problem analytically, we 
will note that the function 


i(t) = i(V5 + V4 cos ot) 


defining the instantaneous values of current is a periodic one with 
period T= 2r/o. Therefore, it can always be expanded in a Fourier 
series 


i(t) — Ig -- Y, I,cos(nat + Pn) (11.8) 


Physically, this implies that the current in a lag-free nonlinear 
element is the sum of the d.c. component and, generally, an infinite 
set of harmonics at frequencies o, 20, 30, .... 

In engineering calculations, the most important task is to find the 
amplitudes of the spectral components of current (Io, I,, I, ...) as 
functions of the bias voltage and of the amplitude of the driving 
voltage V4. Solution is carried out differently, according to the 
form of the approximating function used. 

Piecewise-linear approximation. The waveform of current in 
a circuit containing à nonlinear element such that 


(gm(vo— v), v>Ve (11.9) 


where V, is the cut-off (or cut-in) voltage, and driven by v= V; + 
+ Vmcos ot, is seen from the construction in Fig. 11.5. 

The current waveform is a succession of cosine pulses with cut- 
off. The spectral composition of such a periodic process was 
examined in detail in Chap. 2. 

The cut-off angle* of current pulses can be found from the 
equation 


Vo + Vmcos 92 Ve 


* The cut-off angle is half the angle of current flow or operating angle. 


— Translators's note. 


E 
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lag-free (zero-memo- 
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Fig. 11.5 The current in a circuit containing a piecewise-linear element 


Hence, 


Ve—Vo 





cos $= (11.10) 


m 


The direct component and the amplitudes of current harmonics are 
found by the equations 


{ Io = dm VmYo(9) 
l In=9mVmYn(9) 
which include the corresponding Berg functions y,,(9). 


(11.11) 








Example 11.2. A nonlinear element has a piecewise-linear current- 


voltage characteristics with the following parameters: Ve=0.6 V and 
9m=25 mA/V. The voltage applied to the element is v=0.2+ 
+ 0.8 cos ot (V). Find the d.c. component I, and the fundamental I, 
of the current. 

Since 


06-02 _ 


§= =0. 
cos 08 0.5 


then 
$= 60 


The values of the Berg functions are as follows: 


I 
Yo= =, (sin $ — 9 cos 8) 2 0.109 


1 
N= A — sin 9 cos 9) = 0.196 
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Using Eqs. (11.11), we obtain: 
I, =25 x 0.8 x 0.109 = 2.18 mA 


I, =25 x 0.8 x 0.196 = 3.92 mA 


Power approximation. Let 
i=a,ta,(v—Y)+a,(v—Wyt... (11.12) 
and the voltage applied to a nonlinear one-port be 
v(t) = Vo + V4cosot 
Taking advantage of the well-known formulae 
cos? x = '/,(1 + cos 2x) 
cos? x = '/,(3 cos x + cos 3x) 


cost x = '/,(3 + 4 cos 2x + cos 4x) 


cos? x = 1/,,(10 cos x + 5 cos 3x + cos 5x) 


we can re-write Eq. (11.12) as 
i = (ao + !/5a5 VÀ, + 3/gagVin + ...) 
+ (a, Va + ?/443Vin+ °/g asVint ...)cos ot 
+ (1/5 a5V2,4- 1/3 a,sVint ...) cos 20t 
+ (2/4 a4V& + 3/16 as Vh + --.) COS 30t + ... (11.13) 


Hence, the following relations can be written for the direct 
component of current and the amplitudes of harmonics: 





Ig = do + 1/2 aV 3/gagVint ..- 

li =4,Vint+ 3/4 a4Vm- ga; Vht 

1/5 a5 Vin t !/g da Vin -.- (11.14) 
14a Vnt ^/1g asVm ... 


M —- 
[^] N 
Io 0g 





It is to be noted that the d.c. component and the amplitudes of 
even harmonics are determined by the even-numbered coefficients 
of the Taylor series, and the odd harmonics depend solely on the 
odd-numbered coefficients. 

Exponential approximation. If the current-voltage characteristic 
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of a nonlinear one-port can be approximated with an expression 
of the form 


i(v) = ig [exp (av) — 1] 


the current spectrum can be found on the basis of the equation 


exp (x cena bey Ik(x) cos not (11.15) 


n=1 


where [,(x) is a modified Bessel function of index n. 

If a nonlinear one-port with an exponential current-voltage 
characteristic is excited by the sum of the bias voltage and the 
harmonic signal voltage, that is 


v= Vo + Vn cos ot 


then 


i(t) = io [exp (a Vo) Io (aVm) — 1] 


+ 2i, exp (aV) }. In(aVin) cos not (11.16) 


n=1 


Nonlinear distortion in a resistively loaded amplifier. The 
transformation that the spectrum of the input signal undergoes in 
nonlinear circuits is an extremely important matter. On the one 
hand, this spectrum transformation forms the basis for the 
operation of modulators, detectors and a number of other similar 
devices, which will be discussed below. On the other, the nonlinear 
behaviour gives rise to undesirable effects which must be properly 
evaluated and taken into consideration. 

As an example of nonlinearity effects, we will examine 
a single-stage transistor amplifier loaded into a resistor, Rr. In 
contrast to a small-signal amplifier (see Chap. 8), it will be assumed 
that the amplitude of the input harmonic signal Vmin is sufficiently 
large to make it essential to consider the nonlinearity of the transfer 
characteristic ic=f(vge) of the transistor connected in 
a common-emitter circuit. In the simplest case and with a properly 
positioned operating point, let this characteristic be specified by 
a second-order polynomial: 


iC = ag + 4; (VBE — Vo) + a; (VBE — Vo)? 
If the amplifier is driven by the voltage 
VBE = Vo + Vinin COS ot 


the current in the collector lead will contain a steady (d.c.) 
component and also the fundamental and the second harmonic of 
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the signal, such that, on the basis of Eq. (11.14) 
I, =a Vmin, 15— 1/502 V min 


These harmonic currents produce across the load resistor a voltage 
drop which is included in the output signal of the amplifier and 
distort it. Quantitatively, the degree of distortion in the output 
signal of an amplifier is stated in terms of the nonlinear distortion 
factor ky defined as the ratio of the rms value of all the higher 
harmonics (except the fundamental) to the amplitude of the useful 
signal: 


yü-Ó5e-Hd-.. 





ka= (11.17) 
I, 

In our case, 

ka= L,/I, — !/5(a5/a,) Vin (11.18) 


Importantly, the nonlinear distortion factor increases with 
increasing amplitude of the signal. 


11.3 Nonlinear Tuned Amplifiers 
and Frequency Multipliers 


The key element of almost any radio transmitter is an r.f. tuned 
power amplifier. Its distinction is the fact that it operates at very 
large amplitudes of the input voltage. Therefore it is mandatory to 
take into account the nonlinearity of the current-voltage 
characteristic of the active element involved, which may be 
a transistor (transistors) or a tube (tubes). 

Operating principle of a nonlinear tuned amplifier. Consider 
a single-stage transistor amplifier (Fig. 11.6a) loaded into a parallel 
resonant circuit (usually called the tank). The amplifier is driven by 
a voltage vin(t) = Vo + Vmin cos ot, and the resonant circuit is tuned 
to the signal frequency: @res = ©. 

Suppose that the transistor characteristic ic=f(vpp) is 
approximated with straight-line segments and refer to Fig. 11.60. 
The collector current waveform consists of a series of cosine pulses 
with cutoff (class C waveform). The pulses have a complex spectral 
composition, but the leading role in the operation of the amplifier 
is only played by the fundamental component whose frequency is 
the same as the resonant frequency of the tuned (or tank) circuit. 
The impedance of the tank circuit at harmonic frequencies 2a, 3a, 
... is so low that the higher harmonics do not practically contribute 
to the output signal. 

The fundamental of the collector current produces at the output 
a useful signal whose amplitude is 


Vinout = L1 Rres = gm R res Vmin Yi (9) (11.19) 
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(a) (o) ko 


Fig. 11.6 Nonlinear tuned amplifier: (a) schematic diagram; (b) time 
waveforms of currents and voltages 


In a similar way, using Eq. (11.14) we may write an expression 
for the amplitude of the harmonic signal at the output of the tuned 
amplifier when power approximation is used for the transistor 
characteristic: 


Vinout = Rres(@y Vmin F v^ 5 Vim + "fa as Vain FE se) (11.20) 


The dynamic transfer characteristic of an amplifier. This refers to 
the relation Vy out =J (Vmin) Stemming from Eq. (11.19) or (11.20). 
Naturally. it is required that the dynamic transfer characteristic be 
linear, especially in the case of amplifiers for AM signals. As follows 
from, say, Eq. (11.19), the dynamic transfer characteristic is in the 
general case nonlinear, because the cut-off angle 9 and, as 
a consequence, the Berg function y, (9) depend on the amplitude of 
the driving voltage Vmin. The only exception is when the operating 
point is located at the origin. As can readily be seen, the cut-off 
angle is then 9 — 90^, irrespective of the value of Vmin- 

A further advantage of operation at a cut-off angle of 90° is that 
in the “no-signal” condition the d.c. component of collector current 
is zero. This factor has a wholesome effect on the efficiency of the 
amplifier. 

An important parameter of the dynamic transfer characteristic is 
the width of its linear portion, as it determines the dynamic range 
of the signals being amplified. A natural factor limiting the rate of 
rise of the dynamic transfer characteristic is this: At some critical 
value of the input-signal amplitude, min the tuned-circuit voltage 
becomes comparable in magnitude with the supply voltage Esup. 
Any further increase in the tuned-circuit voltage becomes 
impossible because at some instants of time the collector voltage of 
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the transistor crosses zero. In consequence, the normally turned-off 
collector junction is rendered conducting, and the tuned circuit of 
the amplifier is heavily shunted by the circuit containing the 
collector, base, signal source and power supply. 

If Vnin> Vmin the amplifier is said to be overdriven. This 
condition cannot be used to amplify AM signals. However, by 
bringing down the supply voltage, a tuned amplifier can be brought 
to the overdriven condition, thereby turning it into an amplitude 
limiter, a device which suppresses the parasitic modulation of FM 
or PM signals. 

Power relations in a nonlinear tuned amplifier. Amplifiers of the 
type considered here handle a fairly large amount of power, so high 
efficiency is an important requirement for them. In order to 
determine the efficiency of an amplifier, we need to know the power 
drawn from the power supply 


Psup = IoEsup 


and the useful active power in the tuned circuit 
P useful = "fs Vinout 


In power amplifiers, it is sought to utilize the power supply to 
the utmost, even by coming very nearly to the overdriven operating 
condition, such that Vm out x Esup. Then 


efficiency = Pusetul/Psup = ya (8)/yg (9) (11.21) 


If we analyse the ratio y, (S9/y, (98) we will readily see that it is 
a maximum and equal to two for 9 — 0°. As 9 is increased, the ratio 
falls off, being 1/2 = 1.571 Yor 90°. Therefore, from the view-point of 
power utilization, it would seem advantageous to operate the 
amplifier at small values of 9, when the efficiency of the amplifier 
approaches unity. This would happen because the electron device 
would be turned off for the greater part of the cycle, and no power 
would be dissipated as heat at the collector (anode) This would, 
however, entail a drastic reduction in the value of y,, and in order 
to obtain the desired power output, we would have to substantially 
raise the amplitude of the input signal, which is not always possible. 
Therefore, bearing in mind the linearity of the transfer 
characteristic, the usual practice is to sacrifice some of the efficiency 
and to set the cut-off angle close to 90° (an operating angle of 
about 180°). 

Resonance frequency multiplication. If we tune the tank circuit of 
a tuned amplifier operating at high amplitudes of the input signal 
to no, which is the frequency of one of the signals higher 
harmonics, the device can be used as a frequency multiplier. 

A frequency multiplier comes in useful when one needs a highly 
stable source of harmonic waves which cannot. for one reason or 
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another, be generated directly, while a sufficiently stable low-fre- 
quency oscillator is available. 

Often frequency multipliers are used in FM or PM transmitters 
in order to increase the frequency deviation of the signal. If at the 
input to a multiplier the frequency deviation is Aw, then at the 
multiplier’s output it will obviously be nAo, where n is the 
multiplier factor. 

In principle, the design of a frequency multiplier does not differ 
from that of a nonlinear tuned amplifier. By analogy with 
Eq. (11.19), the amplitude of the output signal from a frequency 
multiplier in the case of piecewise-linear approximation is defined 
by 


Vm,out = 9mRresVininYn (9) (11.22) 


One of the difficulties arising in the synthesis of tuned frequency 
multipliers is that the function y,(9) has a very low value at high 
values of the multiplier factor. Therefore, the cut-off angle must be 
chosen so as to maximize the corresponding Berg function. The 
smaller the ratio of the period to the duration of the collector 
current pulses*, the richer is their spectral composition. Hence, if 
the objective is to build a frequency multiplier with a high 
multiplier factor, the cut-off angle must be chosen very small. From 
analysis of the function y,(9) it is seen that there exists an optimal 
cut-off angle, Sop:, defined as 


Sopt = 180°/n (11.23) 


This is the value of cut-off angle for a frequency multiplier 
operating at a fixed amplitude of the driving voltage Vis. 


11.4 Lag-Free (Zero-Memory) Nonlinear Transformations 
of a Sum of Harmonic Signals 


The property of a nonlinear network to enrich the spectrum of 
the output signal by adding to it the spectral components 
nonexisting in the input wave is most pronounced when the input 
signal is a sum of several harmonic waves differing in frequency. 
The appearance of a large number of new spectral components is 
the basis of the important nonlinear signal transformations that will 
be discussed in the next section. 

The response of a nonlinear element having a po- 
wer-approximation characteristic to a biharmonic excitation. We set 
out to elucidate the response of a nonlinear one-port whose 
current-voltage characteristic is described by, say, a second-order 





* This is the reciprocal of the pulse duty factor, t/T—Translator’s note. 
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polynomial: 
i(v) = ao + a, (v — Vo) + a3 w- V (11.24) 
In addition to the constant term W, the applied voltage contains 


two harmonic waves at different frequencies o, and o;. Their 
amplitudes are Vn, and Vs; respectively: - 


v= Vo + Va, cos 9,t + Ving COS ost (11.25) w, w2 





The frequency spec- 
trum of a biharmo- 
nic signal 


This is known as the biharmonic excitation. It is especially 
convenient in analysing spectrum transformations in nonlinear 
circuits. 


On substituting the signal defined by (11.25) in Eq. (11.24), we 
obtain 


i(t) = ag + a, Vm; cos Mt + a; Vin cos Mot 
+ a5Vm cos? œt + 2a, Va Ving COS œ LCOS Wt 
+ a5 Vm, cos? ost 


After simple rearrangement we obtain the following spectral 
representation of the current in a nonlinear one-port: 


a ^ 
i(t) = |^ + > (Vin + Vina | + ay Vin cos Qt 


2 
aV m 





+ a; Vna COS œt + cos 20,t 


a, VA 
E COS 205 +A Vs Va; cos (0, + 0;)t 


+ a Vni Vn; cos (o, — 04)t (11.26) 


As is seen, the current waveform contains the d.c. components, A^ 
the fundamentals, and the second harmonics of the two input Solve Problem 3 
signals -they all were present prior to the transformation. In 
addition, it contains two new harmonic components at the sum and 
difference frequencies 0, 4 0; and @,—@,. Importantly, the 
amplitudes of these two waves, equal to a5 Vs Vm2, depend on the @ 
amplitudes of the two input signals to the same extent, and vanish Interaction of harmo- 
when one of the two signals is not applied to the input. This is an nics 
indication that the nonlinearity of the one-port is responsible for the 
interaction of the various harmonic components of the aggregate input 
signal. A complete spectral diagram of the current in the one-port 
under consideration for the form of excitation chosen is shown in 
Fig. 11.7. 
The effect of the cubic term of the current-voltage characteristic. 


Part Two. Circuits 





2102 04 + 02201 





Fig. 11.7 Spectral diagram of the current in a nonlinear one-port whose 
current-voltage characteristic is described by a quadratic polynomial. (The 
input signal is a biharmonic wave whose spectrum is shown as a coloured 
block in the figure) 


Let us make our problem somewhat more elaborate by assuming 
that the current-voltage characteristic i(v) contains a cubic term 
responsible for an additional current defined by 


i, =a,(v— V9? (11.27) 
On inserting the signal defined by Eq. (11.25), we get 
i, (t) = a3 [O/, V9, + */2 Vn Vix) cos œt 
+ QAVA; -3/, V2, Vna) COS Wot 


3 3 
m; m2 
cos 3o,t + 








T cos 30. 


+ AVR Ving cos (20, + W2)t 
+ AVR Vn COS (20, — 0,)t 
T Va Và cos (20, + 0,)t 
+ /AVa Ving cos (20, — 0,)t] (11.28) 


As is seen, the cubic term somewhat affects the amplitudes of the 
fundamental terms of current at frequencies o, and w,. More 
importantly, however, there appear new spectral components at fre- 
quencies 30,, 30,, 20, + 05, 20, — ©, 20,+@,, and 20, — 9. 

Intermodulation frequencies. The example we have just analysed 
is a very special case because, firstly, the applied voltage has only 
two spectral components and, secondly, the current-voltage 
characteristic containing a quadratic or a cubic nonlinearity is very 
simple in form. The general statement of the problem is this: The 
current-voltage characteristic i(v) is arbitrary; the input signal is 
represented by a trigonometric sum: 


v(t) — Vy + Y Vink cos ot (11.29) 
k=1 
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It is required to find the amplitudes and frequencies of all the 
spectral components present in the current. 

This problem can be solved in a variety of ways, depending on 
the form of approximation used for the current-voltage 
characteristic [37]. The task of finding the amplitudes of the 
harmonic components usually involves cumbersome calculations, 
and we will not undertake to tackle it. In analysing the frequencies 
of the spectral components in the output signal, we can note, as has 
been confirmed by the previous example, that these so-called 
intermodulation (or combination) frequencies are specified by 
a general expression of the form 


o= |NO; + NW) +... + gm +... | (11.30) 





where the ns are any whole numbers, positive and negative, 
including zero. 
It is usual to group intermodulation frequencies by collecting the 
frequencies for which 
[m | + [n] t o nn] +... =N (11.31) LJ 
Intermodulation fre- 


The number N is called the order or degree of an intermodulation A 
quencies 


frequency. 

As the above example demonstrates, when a system is driven by 
a sum of two harmonic signals, the spectrum of the current flowing 
through the nonlinear element whose current-voltage characteristic 
contains terms of at most the third power includes intermodulation 
frequencies which can be grouped as follows: 





N Frequencies . 





1 0,. 0, 
2 20,, 20,, 0, +@,, 0, — 0, 
3 3e,, 30,, 20, - 0. 20, — 95, 20; +0,. 205 — 0, 





It is important to note that the term of power N in the current- — . 
voltage characteristic is responsible for the appearance of a 
intermodulation components whose highest order is equal to the Work Problem 3 
power of that term. Also, if N is an even number, the associated 
intermodulation frequencies are likewise even: N, N —2, N — 4, up 
to N — 0 (the d.c. component). If, on the other hand, N is odd, the 
intermodulation frequencies are odd, too: N. N —2, N —4, up to 
N =1. 





Example 11.3. A nonlinear element has a cubic current-voltage 
characteristic 


i(v) = a4(v — Vp)? 
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The input voltage contains three harmonic waves: 
v= Vo + Va, cos Wf + Ving COS Wat + Vo3 COS W3t 


Find the frequencies of all the intermodulation components of the 
current. 

Since the power of the characteristic is three, there will be 
intermodulation frequencies with N — 1 and N — 3. The first-order 
intermodulation frequencies are @,, 05, and @3. 

The third-order intermodulation frequencies are: 


30:1, 302, 3@3, | +, +@,+43| 


| +2@,+,2|, | 20,40 3|, | t2@,+0,| 
| 2@,+03|, | +20; +0, |, | +20; +0, | 


Actually, only distinct frequencies need to be taken into 
consideration. The terms 20, +@, and — 206, — œ, have the same 
frequency. 


The filtering of intermodulation frequencies. The use of nonlinear 
devices for signal transformation is based on the following 
principle. When a lag-free (zero-memory) nonlinear element is 

a ag driven by a sum of original waves, the output signal contains all 
ponse ; k : H : 
likely combinations of intermodulation components. If now the out- 
put signal is passed through a linear frequency-selective network (a 
filter), a whole range of useful effects can be achieved because the 
output signal will contain spectral components previously 
nonexistent at the input. 

One of the devices operating by this principle is the nonlinear 
tuned frequency multiplier that has already been examined. The 
spectrum transformation performed by a frequency multiplier is 
very simple because there is only one harmonic input signal. 





11.5 Amplitude Modulation. 
Detection of AM Signals 


The term "amplitude modulator" refers to a device which produces 
across its output terminals an AM signal of the form 


VAM (t) = Va(1 + M cos Ot) cos Wot 

when its input accepts the harmonic carrier wave 
Vean (f) = Vin.car COS Wot 

and the baseband modulating signal 


Vmod (t) = Vinzmod cos Qt 
Most often, amplitude modulators are built to utilize the transforma- 
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Fig. 11.8 Currents and voltages in an amplitude modulator 


tion that the sum of the two applied signals undergoes in a lag-free 
(zero-memory) nonlinear element. + Esup 

The principle of operation of an amplitude modulator. The 
simplest amplitude modulator is a single-stage nonlinear device 
loaded into a resonant (tuned) circuit. The input to the stage is 
a voltage of the form 


Vin (t) = Vo + Vin,mod cos Qt + Vincar COS Wot (1 1.32) 


The resonant circuit in the collector lead is tuned to the carrier 
frequency. The operation of this amplitude modulator: is explained 
for the current and voltage waveforms appearing in Fig. 11.8. 

For definiteness, it is assumed that the current-voltage 
characteristic of the transistor is approximated with two straight- 
line segments. Since the Q-point moves in step with the baseband 
modulating wave, the cwt-off angle of the carrier is continuously 
changing. Because of this the fundamental of the collector current 
pulse sequence is varying in time. The tuned circuit filters the 
collector current so that its output delivers an AM signal, that is, 
a wave whose amplitude varies in proportion to the modulating 
signal. 








Example 11.4. The current-voltage characteristic of the transistor 
used in a modulator circuit has a kink at V, — 0.6 V. The amplitude of 
the carrier at the input is Vincar=0.4 V. The amplitude of the 
modulating signal is Vg moa — 0.1 V. The quiescent bias voltage is 
V, — 0.6 V. Find the modulation factor M for the circuit in question. 

According to the statement of the problem, the Q-point moves 
between the limits Vo + Vmmod = 0.7 V and Vg — Vmmod = 0.5 V. 
Hence, the cut-off angle varies between 

0.6 — 0.7 


9max = pepe sa — 1.823 rad 
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and 


6 — 0.5 





Smin = arc cos — 
0.4 


The amplitude 


of 
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— = 1.318 rad 


the collector-current fundamental is 


proportional to the Berg function y,(9) which varies between the 


limits 
1 A 
¥1(9max) = y Omax — sin 9max cos 953) = 0.657 Solve Problem 4 
and 
l . 
Yı (Imin) = = (9min — sin Imin COS Imin) = 0.342 


Hence, the modulation depth is 


M=- 


Timax p Timina 7 0.657 E 0.342 


= 0.315 





Ii max t+ Ly min 


The spectrum of 


wave at the input of 


a modulator 


0Q Wo 


and at its output 


w 


0 Wo- QD wg W_tQ 


0.657 + 0.342 





Analytical consideration. The production of an AM signal can be 
investigated analytically by using the above theory of 
intermodulation frequencies. Suppose that a nonlinear element 
having the simplest current-voltage characteristic of the form (11.24) 
is driven by the voltage 


v(t) = Vo + Vin car COS Mot + Vi moacos Qt 


such that œ >Q. 

The current flowing through the one-port contains components 
whose frequencies are close to @). These components make up the 
amplitude-modulated current 


iAM(t) = a, VincarCOS Mot + Ay Vin,car Vm,mod COS (Mp + Q)t 
+ 5 Vincar Vinsmod COS (Wo = Q) t (1 1.33) 


As will be recalled (see Chap. 4), the relative level of the side 
lobes in comparison with the carrier is M/2. From Eq. (11.33) it 
follows that in our case the modulation factor is 
2a, . 
— Vinmod (11.34) 


d, 


M= 


Detection of AM signals. Detection (also called demodulation) 
refers to the process of separating the modulating signal from 
a modulated carrier. If the input signal to an ideal detector is an 
AM wave 


Uin(t) = Vinin(1 + M cos Qt) cos ot 
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the wave appearing at its output will be a low-frequency signal 
Vout(t) = Vm.out cos Qt 


proportional to the message signal being transmitted. 
It is usual to define the performance of a detector in terms of the 
detection (or demodulation) ratio 


kdet = Vm, ouy M Vmin (11.35) 


Detection is a strictly nonlinear operation because the spectrum 
of the input wave does not contain the component at frequency Q. 
Detection can be performed by applying the AM signal to a lag-free 
(zero-memory) nonlinear element and by filtering the resultant low- 
frequency components of the spectrum. 

Consider the operation of what is called the collector detector 
which is a single-stage transistor circuit loaded into a parallel 
RC-network. For the load network to operate as a frequency filter 
suppressing all high-frequency spectral components, it is required 
that 


1/0CL& RL, 1/QCL> Rr (11.36) 


This signifies that for the signal at the modulating frequency Q the 
detector load is practically resistive and equal to Rr, whereas the 
magnitude of the load impedance and, in consequence the fre- 
quency response of the system at the carrier frequency o, are neg- 
ligibly small. Let 


Vin(t) = Vo + Vmin( l + M gos Or) cos Wot 


with Vmin being sufficiently large for piecewise-linear approximation 
to be applicable to the current-voltage characteristic of the 
nonlinear element. Also, to simplify matters, let V, — V. (which 
means that the system is biased at cut-off). Then the angle of cut-off 
will be 8 = 90^, irrespective of variations in the amplitude of the 
input signal in time. The operation of the collector detector is 
illustrated in the plots of Fig. 11.9. 

Referring to Fig. 11.9, the collector current pulse sequence is 
amplitude-modulated ; the zero current component is slowly varying 
(at frequency Q), such that 


Ig.C =9mVmin(l + M cos Ot) y, (90°) = 0.3189 m Vinin(1 + M cos Ot) 
The output voltage of the detector is 
Vout(t) = Esup —IycRL 


= Esup — 0.3189m RL Vmin(1 + M cos Qt) (11.37) 


e 
The detection — (de- 
modulation) ratio 


+Esup 





The collector detector 
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e 
Linear detection 
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Fig. 11.9 Waveforms of currents and voltages in a collector detector 


ic 








Hence, the detection ratio of the detector is 
kaet = 0.318g4 Rt (11.38) 


Importantly, the amplitudes of the input and output signals are 
in direct proportion. Quite aptly, this detector is said to effect linear 
detection. Its salient feature is freedom from distortion in the 
transmitted message. 

Square-law detection. Let us consider separately a case of 
importance to applications, involving the detection of weak signals 
when the current-voltage characteristic of the nonlinear element has 
to be approximated with a power relation of the form 


ic(v) = ag + a, (Vin — V9) + az (vin — V9Y +... (11.39) 


We will limit ourselves to the terms written out and assume that 
the detector accepts an AM signal along with a d.c. bias voltage 
Vo: 

Vin(t) = Vo + Vinin(1 + M cos Ot) cos Mot (11.40) 


On substituting (11.40) into (11.39), we find that among the 
various intermodulation waves present in the current, there is the 
following low-frequency component: 


2, 
ür(t) = a2V Žin M cos Qt + zo ni. M? cos 20t (11.41) 


Owing to the filtering action of the load RC-network, the output 
signal will be determined by exactly this current: 


a RL Vinin M 


2 
Vout(t) = Esup — 42RL V min M cos Qt — cos 2Qt (11.42) 


Here the output voltage is proportional to the square of Vmin, for 
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which reason this form of operation is called square-law detection. 
The presence of the term proportional to cos 2Q¢ in (11.42) is an 
indication that square-law detection is accompanied by distortion 
of the received message. On introducing the nonlinear distortion 
factor kni, equal to the ratio of the amplitudes of output waves at 
frequencies 20 and Q, we find from Eq. (11.42) that ky; = M/4. 
Hence it is clear that nonlinear distortion will be especially heavy 
at a high degree of modulation of the input signal. Therefore, in 
receivers it is desirable that the amplitude of the carrier in the AM 
signal applied to the detector's input be limited to a few volts. Then 
the detector will operate in the linear mode and there will be no 
nonlinear distortion in the received message. 

Interaction of the valid signal and noise in a detector. Suppose 
that in addition to the valid AM signal the input of a square-law 
detector accepts an unmodulated noise wave whose frequency o, is 
close to the carrier frequency Ge, such that 


Vin(t) = Vo + Vmjin(1 + M cos Ot) cos Mot + Vinn Cos Ont 


The current due to the quadratic term in (11.39) is then equal to 


i, (t) = a4 (vin — Vo)? = a4Vmin(1 + M cos Ot)? cos?ogt 


+ 2a, Vn in Vann (1 + M cos Or)cos Wot cos Ont + a Vfncos Ont 
(11.43) 


On the basis of Eq. (11.43), the additional low-frequency current 
component, which owes its origin to the noise wave, is equal to 


Aijg(t) = !/; az Vmin Vian M [cos(og — e, + Q)t 


+ cos (Oo — On — 9)t] + az Vmin Vinn COS (00 — On) t 


Thus, even with no modulation (M = 0), there is, at the detector’s 
output, a low-frequency harmonic signal at frequency o, — @n. 
When M #0, the spectrum of the output signal becomes even more 
complex owing to the appearance of the low-frequency 
intermodulation waves at frequencies @) — o, + Q and @) — 64 — 
— Q. These frequencies are close to those of the useful signal and 
cannot in principle be removed by filtering. If Vmn> Vmin, noise 
may substantially exceed the valid signal. In this sense, one speaks 
of the suppression of a weak useful signal by a strong noise. In order 
to minimize signal suppression, every effort should be made to 
reduce as much as possible the noise level during detection. 

The diode AM detector*. This is a widely used type of detector, 





* Tt is otherwise referred to as a linear or an envelope 
detector.— Translator's note. 


E 
Nonlinear distortion 
due to detection 
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Vout 








The output voltage of 
a diode detector is 
close in amplitude to 
the input signal 
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especially effective in large-signal operation. It consists of a series 
combination of a crystal diode and a parallel RC-network which 
acts as a frequency filter. The element values of the RC-network are 
chosen according to the condition defined in (11.36). 

Assume that the diode has a piecewise-linear current-voltage 
characteristic and biased exactly at the cut-off voltage: 


gle menm 
s 0, v<0 


For the circuit to operate normally, it is essential that the load 
resistance R; be substantially greater than the diode resistance in 
the forward direction, that is, | 
gs RU»1 

Let us apply to the detector input an unmodulated harmonic 
signal 
Vin(t) = VininCOS Wot 
The capacitor charges via the forward resistance of the conducting 
diode much faster than it discharges via the high-value load 
resistor, and so the output signal is a sawtooth waveform with low 
teeth. The average level of the output voltage is close to the 
amplitude of the input signal. Thus, the diode remains 
nonconducting for a greater proportion of the cycle. 

Let us neglect the minute variations in the output signal and take 
it that Vout is constant. We also note that Vout is applied to the 
diode in reverse polarity and acts as its bias voltage 


b=- Vout 
The detection factor of the circuit 
kdet = Vout/ Vmin = cos 8 


may be close to unit, because the cut-off angle is sufficiently small. 
The cut-off angle is found from the relation 


— Vo = IoRL = gm Vmin Yo (9) RL 


whence a transcendental equation follows 





R 
cos ł = on™ (sing — $cos $) 
or 
tan 9 — l= n/JmRL (11.44) 





For gmRL>l1, the cut-off angle is zero very nearly, so that the 
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following relation can be derived from Eq. (11.44) for the detection 








factor: 
kdet = cos (3r/gg Ri)! ? (1145) 
A Example 11.5. In a diode detector, Ry — 18 KQ, and the diode 
Work Problem 5 transconductance is gm= 10 mA/V. Find the detection factor. 
The product of the transconductance by the load resistance gives 
JmRL = 180 


Therefore, we may use Eq. (11.45), which yields 
kaet = cos (3.14 x 3/180)!/3 = 0.93 








When the input to a diode detector is an AM wave, then, subject 
to Eq. (11.36), the output voltage of the detector at any time is 
proportional to the instantaneous amplitude of the input signal (the 
modulated carrier). 


11.6 Response of Lag-Free (Zero-Memory) 
Nonlinear Circuits to Stationary Random Signals 


Suppose that the input to a lag-free (zero-memory) nonlinear 

system is a random signal x(t) which is a realization of a stationary 
random process X(t). The output signal y(t) is connected to the 
input signal by a relation of the form 
y(t) — f(x (t) . 
The ensemble of realizations y(t) specifies a stationary random 
process Y(t). We are to find the relation between the statistical 
characteristics of the processes X(t) and Y(t). This can be done, 
using any one of two approaches. 

1. The nth-order multivariate probability density function of the 
input random process, p(X}. X». -< Xm ty, «+ tn. is known and we 
are to find a similar function, pi, yo, .. Yas ty, -s fn), for the 
output process. 

2. Acting within the framework of correlation theory, we set out 
to find the mean m, and the autocorrelation function K (1) of the 
output random process. In addition to the autocorrelation function, 
it may be of interest to find the power spectrum W,(œ) of the out- 
put signal. 

The probability density of the output signal after nonlinear 
transformation. The first objective is achieved by using the techni- 
ques set forth in Chap. 6 for the probability densities of systems of 
random variables subjected to functional transformations. If x,, x2, 





338 


In the case of multi- 
valued functions, a sum 
should be taken of the 
contributions from all 
branches 
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.... Xn are the random variables observed at the input at times ¢,, 
L5, .-» tn, respectively, then, since the transformation is lag-free, we 
will have at the output and at the same instants of time the 
following variables 


yi =f). ya 9 f(x3). -> Vn =f (Xn) (11.46) 
By using the inverse function x = p(y), we have 

x, = 90). X=) o Xn= On) (11.47) 
The multivariate probability density for the output process is 

Poti e Yn) = PinlE (yi) .... PW) | DI (11.48) 


in which the Jacobian D has a very simple form 








dọ (yı) 
——— Q... 0 
dy, 
D-!0 do (yz) 
dy; 
ime T A doy) 
supp amends "mm 


_ de | dg | do 
dy = dy lips dy yy, 
Equation (11.48) yields the solution in the most general form. It 
is to be noted that the structure of the Jacobian determinant (11.49) 
stems from the assumption that the transformation involved is 
a lag-free (zero-memory) one - the instantaneous value of the output 
signal solely depends on the input signal at the same instant of 
time. 





(11.49) 





Example 11.6. A lag-free ( zero-memory ) nonlinear element having 
the piecewise-linear characteristic 


| ax, x»0 
yz 
K 0, x«0 


is driven by a Gaussian random process X (t) of mean value zero and 
with a specified variance o2. The probability density function of the 


input signal is 


1 
Pin(x) = ——— exp( — 


y 210, 


x!/263) 


(11.50) 





Find the probability density function of the output signal. 
For x >0, the inverse function has the form 


x — y/a 


vq) l 
“ aly NM ıı 
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and so 
dx/dy = 1/a 
Therefore, 


1 
Pout(y) = ———— exp( — y?/2o&a?) 
as V2xoxa i 
for y > 0. For any negative value of x there is only one value y = 0. 


To assure the normalization of the probability density function for 
the output signal, we should allow a -singularity in the output 


| Pout probability density pout(y) for y = 0 with a coefficient equal to 1/2: 

1 1 

—8(y) + ————exp( — y?/202.a”) for y 20 

2 y 216xa i 

(11.51) 
y Pout(y) = 
Ü 0 for y «0 
t 


It is fundamentally important that, on applying a Gaussian signal 
to the input of a nonlinear system, we observe a non-Gaussian 


random process at its output. 


The mean value of the signal at the output of a nonlinear system. 
The simplest statistical characteristic of a stationary random 
process is its mean obtained by averaging its realizations over the 
ensemble or, if the process is ergodic, over one sufficiently long 
realization. In order to be able to find the mean of a signal 
subjected to a nonlinear, lag-free (zero-memory) transformation, we 
should have at our disposal the univariate probability density 
function Pout(y). Then 


oO . 


y=my= J yPout(y) dy (11.52) 


Thus, the problem reduces to finding a quadrature. With equal 
success, we could find the mean of a transformed signal by 
averaging the function f(x) with the aid of the univariate 
probability density function of the input signal: 


oc 


y= J flx)pin(x)dx (11.53) 


Example 11.7. Find the mean of the output signal for the system of 


Example 11.6. 
By Eq. (11.53), 


1 0 - —— 
y ——— J (ax/o;) exp( — x?/262) dx = ac /|/2x = 0.39940, (11.54) 


2n o 
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The result implies that the variance of a stationary Gaussian 
process can be measured with the aid of a nonlinear converter 
having a characteristic of the form defined in (11.50), connected in 
cascade with a sluggish linear network which performs averaging 


over time. 


The autocorrelation function of the output signal. By the general 
rule, the autocorrelation function of the signal y(t) at the output of 
a lag-free nonlinear converter is 


Ky(t)= y()y(t +- y 
= fj S(x)f (x0) pin, xr; )dxdx, — y? (11.55) 


So that we could make use of Eq. (11.55), we should know pigs (x, 
X4; t) which is the bivariate probability density function of the 
input signal observed at two sections separated by a time interval t. 

Calculations by Eq. (11.55) may prove fairly cumbersome. The 
final result in a more or less observable form can only be obtained 
for a normal input process when 


l 24 x2 —2Ryxx 
Pin(X, Xr; 7) Jl is d x - farso 





^ 2noiü RJ? "* 204(1 — R3) 


where Rx(t) is the correlation coefficient for the input signal. 


Example 11.8. Find the autocorrelation function of the output 
signal under the conditions given in Example 11.6. 
The main difficulty is to find the mean product 








are XXt x? +x? — 2RxXXı ixd 
=- —exp| — xdx 
We= || 25i — Riz oP 2081-29 | ^ 
60 


By a change of variables, 


E= 


E= 


cx|/20 — R3) 


Xt 


cxV2( — R?) 


t 


we may write the mean product as 


=. 9 
yy«2 —a?o£(1 — R2??I 
T 


where 


I= J J &&exp( - £? — & + 2R,65) dédé: 
00 


The simplest way to evaluate the last integral is by changing to 
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polar coordinates: 
& = pcos o, 5. — psin p 
Omitting simple, but cumbersome calculations, the final result is 
T= WV 
4(1 — RIP”? 


Hence, using Eq. (11.54) we find the autocorrelation function of the 
output signal: 


1 — RÈ + Ryarccos( — R,)] 


K,()- Wi — R2 + Ryarccos( — R3) - 1] (11.57) 


Since for t = 0, the correlation coefficient is R,(0) — 1, the variance 
of the output signal is 


3 


2 





ot = K,(0)= -— (x — 1) = 034082202 (11.58) 
T 
P Therefore, the correlation coefficient of the random process at the 
Work Problems 6 output of a piecewise-linear nonlinear converter is given by 
1 — 
and 7 Ry(09) - — [V1 — Ri Rxarccos( — R) 1] (11.59) 
Tt — 








Nonlinear transformations of narrowband random processes. 
Suppose that the input to a lag-free (zero-memory) nonlinear 
converter is a Gaussian narrowband random process. Its 
realizations are quasiharmonic random waves with central fre- 
quency Gy. The autocorrelation function of the input signal is 


Kx(t) = o2 Rx(t) = o? p(t) £08 Wot (11.60) 


Let us find the autocorrelation function of the output signal with 
special reference to the piecewise-linear element examined in the 
previous examples. The direct substitution for Rx from (11.60) into 
(11.59) yields the desired result, but this technique is not so obvious. 
It is advantageous to rearrange Eq. (11.59) by expanding its right- 
hand side into an infinite series in powers of R(t). To this end, we 
wil take advantage of the fact that 


arccos( — Ry) = n/2 + Ry + R$/6 + ... 


and 
y1- Ris1-R22- Ri8-.. 
Therefore, 


Ry(t)=— (Raf + R3/2 + R3/24 +...) (11.61) 


The effect of the 
higher terms in the 
expansion is negligible 
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On the basis of (11.60) we find that 


1 
Ry(t) = ul i p (1) cos Wot + 1/2p?(t) 


x cos?^agt + 1/24p* (1) cos^agt + ...] (11.62) 


Since 

cos*@ ot = 1/2 + 1/2cos 2091 

and 

COS*W ot = 3/8 + 1/2cos 26,1 + 1/8cos 4a ot 

it follows from (11.62) that 

Ry(t)%0.117p? (x) + 0.007p* (x) + 0.733p (x) cos pt 
+ [0.117p?(t) + 0.01p*(t)] cos 29,1 


+ 0.002p* (1) cos 491 (11.63) 
Hence, by taking advantage of the W-K theorem, we are able to 
identify the form of the power spectrum F,() of the output 
random process. As it turns out, the power spectrum of the wave at 
the output of the nonlinear converter in question breaks up into an 
infinite sum of components each of which represents an individual 
narrowband random process. The “masses” (peaks) of their power 
spectra are observed at frequencies &, 209, 40o, .... Also, the 
power spectrum of the output signal includes a low-frequency 
component in the vicinity of the zero signal, which may be looked 
upon as the outcome of the amplitude detection of the input signal. 

Tt is interesting to note that in this special case the spectrum of 
the output signal does not contain components at frequencies 30, 
50o, .... Undoubtedly, should the nonlinear element have any other 
form of characteristic, we might expect the appearance of all 
harmonics of the central frequency of the input random wave. As 
a rule, the intensity of the high-frequency spectral components 
rapidly falls off with increasing harmonic number. 


The real current-voltage characteristics of lag-free (zero-memory) nonlinear one-ports 


can be approximated with a variety of simple functions. Most frequently, use is made 
of piecewise-linear, power and exponential approximations. 


Fy 

1 w 
0 Wo 
Fy 

w 

0 Wo 2Wp 4wo 6 
Summary 
* 
$$ 


The current flowing in a lag-free (zero-memory) one-port driven by a harmonic 


excitation contains in the general case a d.c. component and an infinite number of 
harmonics, that is, waves at frequencies which are multiplies of the input-signal 


frequency. 


$$ The output voltage of a tuned amplifier operating in the nonlinear mode is a sinewave 


22232232 
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owing to the frequency-selective behaviour of the tuned circuit, despite the 
nonharmonic nature of the current flowing through the tuned circuit. 

When the input signal has a large amplitude, the tuned amplifier is operating in the 
overdriven mode. 

The response of a nonlinear element to a sum of harmonic signals differing in fre- 
quency contains waves at intermodulation frequencies. 

The filtering of appropriate intermodulation waves makes it possible to effect both 
amplitude modulation and amplitude demodulation (detection). 

Under a lag-free (zero-memory) nonlinear transformation, a Gaussian random process 
gives rise to a non-Gaussian random process. 

In order to find the autocorrelation function of a random process at the output of 
a nonlinear converter, one has to have the bivariate probability density function of the 
input signal. 


Review Questions 


1. 


Define the condition under which the nonlinear transformation of a signal may be taken 
as being lag-free. 


2. What current-voltage characteristic must a nonlinear element have for its output current 
to be free from odd harmonics? 

3. Define the considerations governing the choice of the cut-off angle for a large-signal 
tuned amplifier. 

4. State the physical principle underlying the operation of a nonlinear frequency multiplier. 
Why is it that a high multiplication factor is difficult to achieve? 

5. Define the considerations governing the choice of the load parameters for an AM 
detector. 

6. What is the difference between linear and square-law detection? 

7. What determines the choice of the cut-off angle for a diode detector? 

8. Describe the calculation of a univariate and a multivariate probability density function 
for a random process after it has been subjected to a lag-free (zero-memory) nonlinear 
transformation. 

9. What is the salient feature of the nonlinear transformation of narrowband random 
processes? 

Problems 


1. A nonlinear one-port has a current- 
voltage characteristic (mA) of the form 


i(v) = 107? 


What is the analytic expression for this 
characteristic in the vicinity of the operating 
point V, —2 V? 

2. A harmonic tuned amplifier is set up as 
shown in Fig. 11.6. The characteristic of the 
transistor (mA) is approximated by two 


straight-line segments: 


ise 50 (vgg — 0.2) for vgg > 0.2 V 
TOWIBE— 39 for tgp < 0.2 V 


The tuned-circuit impedance at resonance is 
Ryes= 0.8 kQ. The supply voltage is Esup = 
= 9 V. The operating point is positioned at 
the kink of the characteristic. Find the 
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amplitude of the input signal that will 
overdrive the amplifier. 

3. A nonlinear lag-free (zero-memory) 
element has a current-voltage characteristic 
of the form i(v) = ag + a,v + a,v*. 


The voltage applied to the element is 
v(t) = Vm cos œt + Ving COS œt 


Find the amplitudes and frequencies of all 

the intermodulation components of current. 
4. There is a nonlinear resistor whose 

characteristic (mA) has the form 


i(v) = 25v + 4v? 


The voltage applied to the resistor is given 
(in V) by v=5+42cosQt + 1.5cos wot. 
Find the amplitude of the carrier and the 
depth of modulation. 

5. There is a diode detector built around 
a crystal diode whose transconductance is 
gm= 10 mA/V. The load resistor is RL = 
= 20 KQ. The applied AM signal (in V) is 
given by v(t) =S5(1 + 0.6cosQt)cos wot. 
Find the amplitude of the low-frequency (Q) 
signal developed across the detector load. 

6. There is a nonlinear device which is 
a limiter whose characteristic y=f(x) is 





The input of the limiter accepts a Gaussian 
stationary random process X(t) of mean 
value zero and of variance o%. Plot for the 
output realization. Find the mean and the 
variance of the output signal. 

7. A lag-free (zero-memory) nonlinear 
element has a characteristic of the form y — 
—a|x| and is driven by a Gaussian 
stationary noise of mean value zero and 
with an autocorrelation function K,(t)= 
= o62R,(t). Find the expression for the 
autocorrelation function of the output 
signal. 


Advanced Problems 


8. Analyse the free response of 
a nonlinear system which is a parallel LC 
tuned circuit shunted by a crystal diode. 


9. Analyse the operation of the balanced 
modulator shown in the accompanying 
circuit diagram: 





The tuned circuit in the collector lead is 
tuned to o. Show that, if the circuit is 
completely symmetrical, the output signal 
will not contain a component at the carrier 
frequency. 

10. Show that the diode detector set up as 
shown in the accompanying schematic 





diagram has an input impedance of Ri; — 
= R,/2. The input impedance is defined as 
the ratio of the amplitude ln of the input 
voltage to the amplitude of the fundamental 
component Im; of the input current. 

il. Propose a circuit capable of 
demodulating angle-modulated signals. The 
circuit should include a linear frequency- 
selective network and an amplitude detector. 


Chapter 12 


Signal Transformations 
in Linear Parametric Circuits 


Linear systems described by time-dependent nonstationary 
system operators T(t) possess a number of properties of interest 
and value for communication engineering applications. Here, the 
input signal is transformed as defined by 


Vout(t) = T (£) vin(t) (12.1) 


such that, owing to the linearity of the system, 
T (t) (€; Ving + O%2Ving) = %, T (t) vin; + %2 T (t) ving (12.2) 


for any constants o, and o;. 

Circuits described by Eq. (12.1) are called parametric. The name 
arises from the fact that such circuits always contain elements 
whose parameters are time-dependent. The parametric devices most 
commonly used- in communication applications are resistors R(t), 
capacitors C(t), and inductors L(t). 

A salient feature of a linear parametric system is the inclusion of 
an auxiliary oscillator which controls the parameters of the circuit 
elements. 

The prominence given to parametric circuits in 
telecommunications is due to the ability of such systems to 
transform the spectra of input signals, and also to the possibility of 
building low-noise parametric amplifiers. 


12.1 Response of Resistive Parametric Circuits 


A parametric circuit is called resistive (zero-memory ), if its system 
operator is a number k(t) which depends on time and serves as 
a coefficient of proportionality between the input signal vin(t) and 
the output signal tout): 


Vout(t) = k(t) vin(t) (12.3) 


The simplest system of this type is a parametric resistor of 
resistance R(t). The relation connecting the instantaneous values of 
voltage and current in this one-port is 


v(t) — R(t)i(t) (12.4) 


Alternatively, a resistive parametric element may be described in 
terms of the time-variant conductance 


G (t) = 1/R(t) 


Parametric element 


Control oscillator 





The resistive paramet- 
ric network 


G(t) 
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The spectrum of the current in a resistive parametric one-port. As 
a rule, the contro! signal applied to the parametric element from an 
external auxiliary source is periodic in time. Therefore, in studying 
signal transformations in resistive parametric elements, we will 
concentrate on the controlled resistor whose conductance G (t) is 
representable by a Fourier series: 


G(t)=G,/2+ Y. Gxcos (kost — Vj) (12.5) 
k=1 


where o. is the frequency of the control oscillator, and Gp, G,, 
G,, .. and V,, V,, .. are constant numbers determining the 
amplitudes and phases of the corresponding harmonics in the 
conductance spectrum. 

Let the resistive parametric one-port be driven by a harmonic 
signal voltage 


v(t) = Vincos (ost + Ọs) 


Then the current in the one-port will be 





a Vin Go 
i(t) 2 G(t)v(t)= 2 cos (Ost + Ọs) 


+ Y, VnGxcos (koct — Vj) cos (Ost + Qs) 
k=1 


Vma Vag 
= 60s (Ost + 93 + - = Y, Grecos [(6, + kogt 
4 k=1 





V oo 
+ Os— Vy] F Y Groos [(@s— køodt+ọs+Y] (12.6) 
k=1 
Equation (12.6) can be simplified by taking sums over the 
positive and negative indices k, noting that G,=G_x, and Y= 
— P ,,so that 


+o 


i(t)="/2Vm Y. Gxcos[(os-- kogt + os — Vx] (12.7) 
k=-© 


Equation (12.7) defines the spectral composition of the current in 
a resistive parametric one-port: This current contains a component 
at the signal frequency with an amplitude V,,G,/2, and also 
a number of intermodulation waves at frequencies & + k@ (k= 
+1, +2, +3,..) and with amplitudes V,,G;/2. The spectral 
diagram of the current is symmetrical about ag. 

It may be noted that in a sense the spectral composition of the 
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current in a parametric resistor is simpler than that in a lag-free 
(zero-memory) nonlinear element. For one thing, it does not 
contain any harmonics of the signal frequency. 





v(t) 





The parametric net- 
work with a resistor 
and a switch 





JB 
The effect of current 


rectification at 
6 = 90° 


Example 12.1. Consider a parametric network formed by a fixed 
resistor R and a switch which connects the resistor periodically to 
a voltage source v(t)= V,,cos ost. The period of the control signal is 
Tc. The switch operates so that during the time interval ( — T 42, 
T2) the circuit is completed for all t's satisfying the condition 
— 9, < axt < 9,, and is open for the remaining instants of time. Find 
the amplitudes of all spectral components of the current. 

As follows from the statement of the problem, the conductance 
G (t) of the network is an even function that can be expanded into 
a Fourier series of the form (12.5) only in terms of cosines with zero 
initial phases Y. The corresponding Fourier coefficients are 


9o 
Gy — Q/nR) f cos kEd& = Q/knR)sin k9, (12.8) 
-9, 


The intermodulation current components at frequencies Q9, + ko 
will have the amplitudes 


Ik= (Vm/knR)sin ko (12.9) 


Interestingly, if the input signal and the control wave are 
synchronous (Ws= ox), a steady (d.c. component will be present 


Igc— (Vy/nR)sin %, k= — 1 
In the circumstances, the parametric network operates as a rectifier: 


the current is produced only by the positive half-cycles of the cosine 
wave. 





Implementation of resistive parametric elements. In practice 
parametrically controlled resistors are implemented as follows. 
A lag-free (zero-memory) nonlinear one-port whose current-voltage 
characteristic is i=f(v) is driven by a sum of two waves: the 
control voltage v,(t) and the signal voltage v,(t) The control 
voltage is chosen to be substantially greater in magnitude than the 
signal. The current thus produced in the nonlinear one-port may be 
written by expanding the current-voltage characteristic in a Taylor 
series in terms of the instantaneous value of control voltage: 


i = f (ve + v) =f (vg +f’ (cc) ds + z (vg v2 +... (12.10) 
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The signal amplitude is chosen so small that we may neglect the 
second and higher powers of vs(t) in Eq. (12.10). By using i,(t) to 
designate the increment in the current through the one-port due to 
the presence of the signal, we get 


is(t) f" (vc(t)) vs = galve(t)) vs (12.11) 


As is seen, the dynamic transconductance (the slope of the current- 
voltage characteristic) is determined by the "large" control voltage. 

The most important applications of resistive parametric elements 
will be discussed in the pages that follow. 

Frequency conversion. This refers to the transformation of the 
spectrum of a modulated signal, consisting in that the modulated 
signal is translated from the vicinity of the carrier frequency Ocar to 
the vicinity of some intermediate frequency œi, such that the form of 
modulation remains unaffected. 

A frequency converter (also called a frequency changer) consists of 
a mixer which is a lag-free parametric element, and a local oscillator 
operating at frequency «jo which serves to control the mixer 
parametrically. The local-oscillator voltage causes the dynamic 
slope of the current-voltage characteristic of the mixer to vary 
periodically in a manner defined by 


galt) = gg + 91 COS Olot + g2 COS 20)jot +... (12.12) 
If the input to the frequency converter is an AM signal 
v(t) = Vm(1 + M cos Qt) cos ost 


then, by virtue of Eqs. (12.11) and (12.12), the output current will 
contain a component defined by 


is(t) = Vm(1 + M cos Ot) [go cos ost + !/; g, COS (Olo — ©) t 
+ 1/441 COS (Olo + Ws)t + 1/3 g2 cos (2015 — 9t 
+ 1/,g5c0s (2015 + 6) t...] 


Customarily, the intermediate frequency (i. f.) is chosen such that 
j= |O] — @s|. The current at the intermediate frequency 


gi Vin 
= —(1+ M cos Or) cos wit (12.13) 





iie(t) = 


is an AM wave modulated in the same manner as the input signal. 

In order to extract the spectral components at frequencies close 
to the intermediate frequency, the output circuit of the frequency 
converter includes a tuned circuit tuned to o. 
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Y Input 
(front—end) 


circuits 





Fig. 12.1 Block diagram of a superheterodyne receiver 


Frequency conversion is widely used in superheterodyne receivers. 
A block diagram of a superheterodyne (or superhet) receiver is 
given in Fig. 12.1. It operates as follows. The signal picked up by 
the antenna is conveyed via the input circuits and an r.f. amplifier 
(RFA) to the frequency converter. The output signal of the fre- 
quency converter is a modulated wave whose carrier frequency is 
equal to the intermediate frequency of the receiver. The bulk of 
receiver amplification and receiver selectivity is assured by 
a narrowband i.f. amplifier (IFA). 

An important distinction of a superhet receiver is that its 
intermediate frequency remains unchanged. In tuning a superhet 
receiver, one only has to vary the tuning of the local oscillator and, 
in some cases, of the tuned circuits that may be present in the input 
circuits and in the RFA. 

It is to be noted that the frequency converter responds equally to 
two frequencies, namely Ms, = Olo + 6; and @s2 = Wo — Oi. In radio 
engineering, it is customary to say that reception is possible over 
both the main channel and its image channel. To avoid ambiguity 
in receiver tuning, the selectivity of the resonant circuits placed 
between the antenna and the frequency changer is adjusted in such 
a way that practically all of the image-frequency signal is rejected. 

Conversion transconductance. The effectiveness of a frequency 
converter is customarily stated in terms of a special parameter 
called the conversion transconductance, ge. It is defined as the ratio 
of the amplitude of current at the intermediate frequency to the 
amplitude of the unmodulated signal voltage: 


gc 7 Imit Vms 
As follows from Eq. (12.13), 


c7 91/2 (12.14) 


Or, in words, the conversion transconductance is equal to half the 
fundamental of the dynamic transconductance of the parametric 
element. 


a 
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Suppose that the nonlinear element included in the frequency 
converter has a quadratic current-voltage characteristic: 


i(v) = bv? 

In the no-signal condition, the element is driven by the sum of the 
bias voltage and the local-oscillator voltage: 

ve = Vo + VmioCOS @lot 

The dynamic transconductance of the frequency converter varies in 
time as given by 

ga = 2bve = 2bV, + 2bV mlo COS Olot (12.15) 


Referring to (12.14), we can see that in this case 
Qc = bV mlo (12.16) 


Thus, with the input signal held constant, the amplitude of the out- 
put signal of the frequency converter is directly proportional to the 
amplitude of the local-oscillator voltage. 

Let us illustrate the calculation of a frequency converter with 
a simple example. 


Example 12.2. A frequency converter uses a nonlinear element (a 
transistor) whose current-voltage characteristic is ic = 20vbr, so that 
b = 20 mA/V?. The tuned circuit in the collector lead has a resonant 
resistance Rres = 3 KQ. The amplitude of the unmodulated input signal 
is Vms= 50 pV, and the amplitude of the local-oscillator voltage is 
Vo — 0.5 V. Find the amplitude of the i.f. voltage at the converter 


output, V mif- 


From Eq. (12.16), the conversion transconductance is 
gc — 20 x 0.5210 mA/V 


The amplitude of the output current at the intermediate frequency 


1S 


I mit= Je Vins = 0.5 pA 


Assuming that the output impedance of the transistor is 
sufficiently high for its shunting effect on the tuned circuit to be 
negligible, the amplitude of the i.f. voltage is 


Vmit= 15 mV 





Synchronous detection. Suppose that the local oscillator of a fre- 
quency converter is tuned exactly to the signal frequency, and, in 
consequence, the dynamic transconductance varies in time as given 
by 


galt) = gg +g, COS Ost + g, cos 20st + ... 
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If the voltage applied to the frequency converter is an AM signal 
defined by 


vs(t) = Vms(1 + M cos Qt)cos (@st + Os) 
the current due to the signal voltage will be 


is(t) = Vins(1 + M cos Qt) [go cos (ost + Qs) 


+ '/2g1 cos (2mst + Ps) + */2g1 cos Ps + ...] (12.17) 


Here the expression in the square brackets contains a steady (d.c.) 
component, (g,/2) cos os, which depends on the phase shift between 
the local-oscillator voltage and the input-signal carrier. Therefore, 
the spectrum of the output current acquires a low-frequency 
component 


iy(t) = (Vmsg,/2)(1 + M cos Qt) cos Qs (12.18) 


This current faithfully reproduces the message being transmitted. 

A synchronous detector (or synchronous demodulator) is a fre- 
quency converter operating subject to the condition ojo = &,. In 
order to extract the useful signal, the output circuit includes 
a low-pass filter, such as a parallel RC-network. 

In practice, the use of a synchronous detector is handicapped by 
the fact that an exact phase relation must be maintained between 
the input-signal carrier and the local-oscillator voltage. The best 
choice is 9; — 0°. If, on the other hand, s= 90°, the useful output 
signal vanishes. However, this sensitivity of a synchronous detector 
to the phase shift can be utilized in measuring the phase relations 
between two coherent waves. 

The example that follows illustrateg the calculation of a specific 
type of synchronous detector. 





The synchronous de- 
tector (demodulator) 





Example 12.3. A synchronous detector is built around a transistor 


whose characteristic ic — f(vgg) is approximated with two straight- 


lc, mA 
- line segments. The approximation parameters are: gm= 50 mA/V and 
40 Vc — 0.3 V. The amplitude of the local-oscillator voltage is Vinjo= 
=1 V; the direct bias voltage is zero (Vy —- 0). The unmodulated 
E FA o signal voltage with an amplitude V,,,— 25 uV is shifted in phase 
079.3060. VBE» relative to the local oscillator through an angle ọ;=45°. Find 


Vlo 


variations in the d.c. voltage at the output of the synchronous detector 
caused by the useful signal, if Ri = 1.2 KQ. 

In the case of a piecewise-linear nonlinear element the dynamic 
transconductance (the slope of the current-voltage characteristic) 
may take on only two values: 


0, Uc < Veutotf 
gd— 
m Uc > Veutoff 
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Therefore variations in the dynamic transconductance with time 
can be represented by a periodic series of rectangular video pulses. 
The cut-off angle $ which defines the duration of the pulses can be 
found from (see Chap. 2) 


Ve V. 
9 — arc cos E cc 272.5 
m.lo 


In order to determine the amplitude of the fundamental term of 
the transconductance. we may use Eq. (128) in which the 
conductance 1/R is replaced with gm, the transconductance of the 
transistor within the active region of the characteristic. Then 


gı = Qgmw/n)sin $ = 0.607g,, = 30.35 mA/V 


In accord with Eq. (12.18), the useful signal brings about the 
following increment in the current flowing through the transistor: 


Ai = (Vinsg1/2) cos Qs = 0.268 pA 


Hence, variation in the direct voltage level at the output of the 
synchronous detector is 





Av= — AiR, = — 0.32 mV 





e 
The pump oscillator 
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12.2 Energy and Power Relations 
in Reactive Parametric Elements 


Reactive parametric elements, that is, those in which either the 
capacitance, C(t), or the inductance, L(t), is varying with time, 
display a whole range of spectral properties. Taking 
a parametrically controlled capacitor as an example, we will 
demonstrate that, given certain conditions, such elements can act as 
“intermediaries” which transfer power from external control 
sources, called pump oscillators, to circuits carrying the useful signal. 
This principle underlies parametric amplification which will be 
studied in the next section. 

Relation between the capacitance of a capacitor and the stored 
energy. To get proper insight into the physical foundations of the 
processes taking place in reactive parametric circuits, let us consider 
the following idealized system. Let a flat capacitor whose plates are 
spaced a distance x, apart, be charged to a voltage V,. The 
capacitor carries a separated charge Q — CV,, where C is its 
capacitance. 

Suppose that by some mechanical means the capacitor plates are 
moved apart and the spacing between them is increased to x, + dx. 
The displacement is directed against the electric-field force which 
tends to move the capacitor plates closer together. In overcoming 
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the field force, external forces have to do some positive work on the 
system, with the result that the field energy stored in the capacitor 
is increased. 

In order to obtain quantitative results, we note that the original 
energy stored in the capacitor is 


E-Q'DC (12.19) 


When the capacitance is incremented by dC, the energy increment 
is 


dE = — (Q?/2C?)dC = — EdC/C (12.20) 


because there is no conduction current flowing, and the charge 
Q remains unchanged. On finding the capacitance C from the 
equation for a flat capacitor (known from physics), 


C — £gA/Xo 


(where A is the surface area of a capacitor plate), we obtain the 
following expression for the relative increment in capacitance: 


dC/C = — dx/xg 
On inserting the above result in (12.20), we get 
dE = E dx/xo (12.21) 


As should be expected, Eqs. (12.20) and (12.21) show that in order 
to increase the electric-field energy stored in a system, the 
capacitance of the charged capacitor must be decreased by some 
external factors. 

Parametric excitation Of a resonant circuit. So long as the 
capacitor charge Q is held constant, no continuous inflow of energy 
into the system can be brought about by varying the capacitor 
capacitance about some mean value. The point is that on doing 
a positive work over the time interval while the capacitance is 
decreased, the external source will receive from the capacitor the 
same amount of energy during the next time interval when the 
capacitance is increased. Naturally, the energy averaged over 
a period (or cycle) will be zero. 

The picture is entirely different in a resonant circuit when the 
voltage across the capacitor due to the free process crosses zero and 
changes sign. Consider a high-Q resonant circuit formed by a fixed 
inductance L, a parametric capacitance C(t), and a loss resistance 
R. Suppose that in some unspecified manner natural (free) 
oscillations have been produced in the tuned circuit. Neglecting the 
insignificant decrease in the amplitude of the oscillations due to 
losses, let us take it that Vic, the amplitude of the voltage across 
the capacitor, varies in time at the frequency of natural (free) 
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oscillations 
Onat = 1/]/ LCo 
where C, is the mean capacitance of the parametric capacitor. 
Assume that the capacitance of the capacitor varies periodically 
in the following manner: Twice over a period of natural oscillations 
the capacitance undergoes a negative-going jump by AC at the 
instants when the voltage across the capacitor is at an extremum 
(positive or negative), and is restored to its original value or, which 
is the same, undergoes a positive-going jump by the same amount 
at the instants when the voltage across the capacitor crosses zero. 
This pumping action will result in a unidirectional flow of energy 
into the resonant circuit. Indeed, the work done by external forces 
at the instants when a negative change of capacitance takes place 
will always be positive, irrespective of the sign of the voltage across 
the capacitor. On the other hand, no energy will be expended at the 
instants when the voltage across the capacitor is zero and there is 
no electric field to give rise to forces of repulsion. 
If 


1 I 
Ecmax = E Vin.c(Co + AC/2)x > VA Co 


is the maximum energy stored in the capacitor, then, in accord with 
Eq. (12.20), the energy pumped into the tuned circuit over a period 
of natural oscillations will be 





Epump = 2E C max AC/C, = Vic AC (12.22) 

At the same time, the mean power lost in the tuned circuit will be 
I. 1 Vàc | Vite 

Pioss = E In R— 2 p? R= 2 pQ (12.23) 


The total power dissipated in the resistor over a period of 
oscillations, T, will be 


Ejoss = Pioss T = Vic Co /Q (12.24) 
If the equality 
E pump = Floss (12.25) 


is satisfied, the pump source will make up for the losses in the 
tuned circuit. If, on the other hand, Epump> Eloss, the system will 
turn unstable, and the amplitude of the oscillations in the circuit 
will build up exponentially—the oscillatory circuit is said to be 
excited parametrically. From Eqs. (12.22) and (12.24), we can derive 
the following relation defining the critical relative variation in 
capacitance: 


ACecr/Co = n/Q (12.26) 
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As a rule, the values of AC, are small As an example, for 
parametric excitation of a tuned circuit with C, = 20 pF and Q = 
= 100, it will suffice for AC to be 0.63 pF. 

In the above analysis, we proceeded from the assumption that the 
pump signal changes the capacitance of the capacitor twice over 
a period of the natural oscillations. It is easy to see, however, that 
the parametric excitation of the oscillatory system will take place 
also when the fundamental frequency of the pump voltage is 
pump = Onai” (n = 1, 2, ...). What is important is that the spectrum 
of the pump signal should contain a component at frequency 2@nat- 

It is also required that a precise phase relation be maintained 
between the natural oscillations of the tuned circuit and those of 
the pump oscillator. A shift of the pump signal by a half-cycle in 
phase so that the positive change of capacitance occurs at the 
instants when the voltage across the capacitor passes through an 
extremum will cause the parametric capacitor to act as an 
additional resistive load instead of as an energy source. 

Relation between the voltage across and the current in 
a parametric capacitor. Consider a circuit formed by a source of 
signal voltage 


v(t) = Vcos (Ost + Ọs) 


and a controlled capacitor whose capacitance varies in time 
harmonically at the pump frequency: 


C (t) = Co [1 + B cos (OGpumpt + Ppump)] (12.27) 


Here B is a coefficient defining the degree of modulation of the 
capacitance. Since the charge on the capacitor is 


q — C(t)v 


the current in the circuit is 


= — BG pump Co VmSin (Gpumpt + Q pump) COS (Ost + Ps) 
— Os Co Vmsin (ost + Ps) 


— BOs Co Vincos (Opumpt + Ppump) Sin (@st + Ọs) (12.28) 


Taking advantage of a known trigonometric formula 


cos xsin y = !/; [sin (x + y) — sin (x — y)] 


we may write the products in the first and third terms on the right- 
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hand side of Eq. (12.28) as follows: 


Sin (Opumpt + Q pump) COS (Gst + Ọs) 
Ll {sin [(@s + Gpump) t + Ọs + pump] 
— sin [(@s — ®pump)t + Ps — Ppump]} (12.29) 


COS (Opumpt + € pump) sin (Ost + Ps) 


= ly {sin [os +F pump) É + Qs + pump] 


— sin [(@pump — @s)t + Qpump — 9;5]j (12.30) 
Thus, 
i(t) = — (s Co Vmsin (Gs t+ Qs) 
C, V, . 
+ Te (n — @pump) sin [(@pump — Qs) t 
C, V, 
+ Qpump — 9s] — PEN 5 = (@pump + @s) 
x sin [(@s + @pump) £ + Ps + Ppump] (12.31) 


Equation (12.31) establishes the form of the current spectrum in 
a parametric capacitor. In addition to a component at the signal 
frequency, the spectrum contains two side frequencies, ®s — pump 
and @s + @pump. 

The mean power drawn by a parametric capacitor at the signal 
frequency. Circuit theory tells us that for the mean power flux 
between a source and its load to be non-zero, it is required that, 
firstly, the current and voltage under harmonic conditions be 
described by functions of one and the same frequency, and, 
secondly, the phase shift between the current and the voltage be 
other than 90°. 

As follows from (12.31), the current flowing through a parametric 
capacitor always contains a reactive component at the signal 
frequency: 


ireact (t) = — Ms Co Vmsin (@st + qx) 


Being in quadrature with the source voltage, this current does not 
dissipate power on the average. 

If, however, we choose a suitable pump frequency, one more 
current component can be added at the signal frequency. As follows 
from Eqs. (12.29) and (12.30), for this to happen it will suffice to set 
Opump = 29s. Then the current through the parametric capacitor 


Ch. 12 Signal Transformations in Linear Parametric Circuits 


will acquire a useful component 


BosCo Vm . 
iuseful(£) = — ar sin (@s t + pump — Ps) (12.32) 


The instantaneous power in the useful component is 
Puseful (£) = v (t) iusetui (É) 


| Bes Co V2, 


5 COS (Ost + Ps) SiN (Ost + Qpump — €x) 


Gs; Co Vn. 
rm m [sin (ost + pump) — sin (29, — Opump)] 


The power averaged over a period of the signal is 
T 


1 s 
Pay = T J Pusetul (t) dt 


@sC, Và . 
= Bas Co Vin in (20s — pump) (12.33) 


The equivalent circuit of a parametric capacitor. Equation (12.23) 
indicates that the average power may be positive or negative, 
depending on the phase relation between the input signal and the 
pump output. This implies that, through a suitable choice of the 
phase angles s and Qpump. a condition can be secured in which 
a parametrically controlled capacitor will behave as an active 
circuit element by supplying, rather than consuming, power at the 
signal frequency. : 

On writing ® = 29. — Qpump, the average power in a parametric 
capacitor may be written as 


Pay = V&j2Ri 


where 





Rin = 2/Bos C, sin ® (12.34) 





is the insertion resistance, that is, one introduced by this element 
into the circuit. Hence, the equivalent circuit of a parametric 
capacitor controlled by a pump oscillator at twice the signal fre- 
quency is a parallel connection of a capacitor C, and a resistor Rin. 
If this element is to act as an oscillator, it is necessary for the 
insertion resistance to be negative. The average power delivered 
into the circuit increases with decreasing magnitude of the negative 
resistance. 
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12.3 Principles 
of Parametric Amplification 


The ability of controlled reactive one-ports to behave as active 
circuit elements under certain conditions is the basis of a special 
class of devices known as parametric amplifiers. They are mainly 
used at microwave frequencies as the input stages of highly sensitive 
receivers. The principal virtue of parametric amplifiers is the low 
level of internal noise, since they contain no sources of shot noise. 

Implementation of parametrically controlled reactive elements. 
Theoretically, the feasibility of parametric amplification was proved 
early in this century. It was not until the 1950s when the early 
successful parametric crystal diodes had been developed, that the 
idea could be realized. For their operation, parametric crystal 
diodes, more frequently called varactors, depend on the following 
effect. If we apply a voltage in reverse polarity to the P-N junction 
of a varactor, the separated charge q in the barrier layer will be 
a function of the applied voltage v. The relation q(v) is called the 
charge-voltage characteristic of a varactor. A change in the applied 


voltage causes a displacement current to flow across the 
reverse-biased junction 
i = dq/dt = (dq/dv) (dv/dt) = Ca (v) dv/dt (12.35) 


where Ca(v) is the dynamic (or incremental) capacitance of the 
varactor. It has been found that the dynamic (incremental) 
capacitance (pF) of a point-contact varactor is approximately given 
by 

Ca(v) = C (0) V/1 + 21v] (12.36) 


where C (0) is the dynamic capacitance at zero bias voltage, and v is 
the applied voltage, V. The higher the bias voltage, the smaller the 
dynamic capacitance. 

Present-day varactors show a high-quality performance and can 
operate at frequencies up to tens of gigahertz. 

It is also possible to build elements with a parametrically 
controlled inductance, L(t). These are coils with cores made of 
a ferromagnetic material whose magnetic induction B strongly 
depends on the bias current I.. At radio frequencies, however, 


. variable-inductance elements (frequently called varindors) have not 


found any appreciable use because the cyclic magnetization of the 
material entails a marked time lag. 

The single-stage parametric amplifier. Consider the signal source 
formed by a conductance G, connected in parallel with an ideal 
source of current with amplitude /,,. The signal source is loaded 
into a resistive load whose conductance is GL. The voltage 
appearing between the circuit terminals is 


Vin = Im/ (Gs + GL) 
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so the power in the load is 
l IGL 
2 (Gs + GL? 


A decrease in the conductance of the signal source leads to an 
increase in the power in the load. Thus, the effect of amplification 
can be achieved by reducing in some way the internal conductance 
of the signal source. One way to achieve this is to connect the 
signal source in parallel with a parametric capacitor whose 
capacitance varies at twice the signal frequency, and the initial 
phase of the signal is chosen such that the insertion resistance Rin 
(see Eq. (12.34)) is negative. This principle is implemented in the 
simple single-stage parametric amplifier shown schematically in 
Fig. 12.2. 


PL= (12.37) 


C(t) 





(a) (5) 


Fig. 12.2 Single-stage parametric amplifier: (a) schematic diagram; (b) 
equivalent circuit 


Referring to Fig. 12.2, the auxiliary inductance L and the 
capacitance C, (see Eq. (12.27)) make up a parallel resonant circuit 
tuned to the signal frequency. The resonant circuit has a very high 
input impedance, so it does not shunt the conductance inserted by 
the varactor in parallel*with the resonant circuit and equal to 


Gin = 1/Rin = Bos Co sin ®/2 (12.38) 
Referring to Fig. 12.2b, it is seen that the power dissipated in the 

load is now equal to 

1 Pa GL 

2 (GL + Gs + Gin)? 

If Gin < 0, then P1 > PL. From a comparison of Eqs. (12.37) and 


(12.39), the following expression can be written for the power gain 
factor 





P= (12.39) 





G+tG. V 
"(usas (12.40) 


GL + Gs + Gin 





As an example, for a parametric amplifier with GL = 0.013 S, G; = 


When the stated condi- 
tions are satisfied, the 
parametric amplifier is 
said to operate in the 
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= 0.01 S, and Gin = — 0.02 S, the power gain factor is 
Kp = 0.0237/0.003? = 58.78 


or, on the decibel scale, 
Ap = 10log,, Kp = 17.69 dB 


The stability of a parametric amplifier. Should the negative 
conductance of the varactor completely balance both the internal 
conductance of the signal source and the load conductance, the 
parametric amplifier will jump into self-excited oscillations. 
Equation (12.39) shows that this occurs at the critical value of the 
negative insertion conductance, defined by 


Giner = — (Gs + GL) (12.41) 
Assuming that the phase relations between the signal and the 
pump output are optimal in the sense that sin ® = — 1, then, from 


Eqs. (12.34) and (12.41) the critical degree of capacitance 
modulation is found to be 
. 2(Gs t Gr) 


= 12.42 
Ber aren ( ) 








Example 12.4. A single-stage parametric amplifier operates at 


6 GHz (= 5 cm). The signal source and the load have the same 
conductance of 0.005 S (Rs = Ri = 200 Q). The capacitance of the 
varactor is Cg — 0.8 pF. Find the limits of capacitance variation at 
which the circuit jumps into self-excited oscillation. 

From Eq. (12.42), we get 


Bes = 2 x 001 
7 7 628 x 6 x 10? x 08 x 10 2 


Thus, the parametric amplifier will jump into self-excited 
oscillations if the capacitance of the varactor varies harmonically in 
time between the limits Cmax = Co (1 + Ber) = 1.328 pF and Cmin= 
= Co (Í — Ber) = 0.272 pF. 


= 0.66 








Parametric amplification in the asynchronous condition. In 


practice, it is difficult, if at all possible, to satisfy the condition of 
synchronism, ®pump= 2s, exactly. If the signal frequency is 
somewhat off the desired value, that is, if 

Os = @pump/2 + oo 


the parametric amplifier is said to operate in the asynchronous 
mode. Now 4, which, in accord with Eq. (12.34), controls the value 
of the insertion resistance, is a function of time: 


® = 20s — Opump — Sot 
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Varying as 
2 





Ri Bos Co sin (265 — @pump — Seat) 

the insertion resistance changes sign periodically. In consequence, 
the output signal undergoes deep variations in level, similar to 
beats. This drawback of single-stage parametric amplifiers is 
a serious obstacle to their practical use. 

The double-stage parametric amplifier. Attempts to improve the 
performance of parametric amplifiers have resulted in 
fundamentally distinct parametric amplifier designs which are free 
from the above shortcomings. These are double-stage parametric 
amplifiers (up-converters and down-converters) which can operate 
with any phase relation between the signal and pump frequencies 
and irrespective of the initial phases of the two waves. This effect is 
achieved through the use of an auxiliary oscillation at one of the 
intermodulation frequencies. 

A circuit schematic diagram of a double-stage parametric 
amplifier is shown in Fig. 12.3. It is seen that the amplifier consists 
of two tuned circuits. One, called the signal tuned circuit, is tuned to 
@s ; the other, called the idling (or idler) circuit, is tuned to the idler 
frequency Oidler = ®pump— Gs. The two circuits are coupled by 
a varactor whose capacitance varies in time harmonically at the 
pump frequency Gpump: 


C (t) = Co (1 + Bcos Gpump f) 


If c, (t) and viaiec(t) are voltages across the signal circuit and the 
idler circuit, respectively, then the current through the varactor is 


d 
i(t)x Ca o — Vidler) (12.43) 


Suppose that 
vs (t) = Ving COS ext (12.44) 





Fig. 12.3 Double-stage parametric amplifier 
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The intermodulation components of the current flowing through 
the varactor include a component at the idler frequency 


lidler (t) = Im,idler COS (Gidler £ + V) (12.45) 


where Imider and ¥ remain to be defined yet. 
Assuming that we know Rres,idier, the resonant resistance of the 
idler circuit, we may write 


Vidter (t) = Imidter Rres,idler COS (Gigter £ + P) (12.46) 


On substituting (12.44) and (12.46) in (12.43), we obtain the 
following expression for the current in the parametric capacitor: 


i(t) = Co (1 + B cos Wpumpt)[ — @s Vs sin ost 
+ idler Im idler Rres,idler sin (idler £ + Y] 


In order to derive iidler(t) from the above expression, we note 
that the component at Gidler — Opump — Os can be obtained only 
from the product 


COS Opump $ Sin st = '/, [sin (Gs — Gpump) t 


+ sin (6s + @pump) £] 


Thus, the current at the idler frequency does not depend on the 
voltage across the idler circuit, vigier(t), and is equal to 





Os Co Vins . 
lidler (£) = PORE sin Gigler É (12.47) 
Therefore, 

Ms Co Ving Rresi : 
vals (t)= p s C o " ms I*residler sin Widler t 


2 


Now let us find the current through the varactor at the signal fre- 
quency, i;(t). By analogy with the previous reasoning, we find that 
this current is independent of the voltage across the signal circuit, 
v(t). Noting that 

— dvidier Bos Gidler Co Vins Rres,idler 
————— - COS Midler t 


dt 2 
and 





l 
COS @pump £COS (Wpump — Ws) = — [cos «x t + cos (2@pump — @s) t] 


we find that 


— B75 Midler Co Vins Rres,i 
ig (f) _ p s Midler = ms 4Ntes,idler COS Wet (i 2.48) 
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Therefore, the conductance introduced in the signal circuit by the 
series combination of a varactor and the idler circuit is equal to 


(12.49) 





Gn = is (t) _ B Os Widler Có Rresjdler 
a Us (t) 4 





Since the insertion conductance is negative, the circuit is capable 
of amplifying the signal in power. The gain factor is found by Eq. 
(12.40). Stability analysis is carried out in the same way as for the 
single-stage parametric amplifier. 

If we compare Eqs. (12.38) and (12.49), we will above all see that 
in a double-stage parametric amplifier the negative insertion 
conductance is in no way related to the initial phases of the signal 
and the pump output. Also, the precise choice of ws and pump is 
not critical. The insertion conductance will always be negative so 
long aS @pump > Ws. 

Power balance in multistage parametric amplifiers. The 
insensitivity of a double-stage parametric amplifier towards the 
phase relation between the signal and the pump output makes it 
possible to analyse such systems on the basis of simple power 
relations. Let us turn to the general circuit diagram in Fig. 12.4. 

Here, three circuits are connected in parallel with a nonlinear 
capacitance Cy). One is the signal circuit, the second is the pump 
circuit, and the third is the idler circuit tuned to an intermodulation 
frequency 


Qj = MOs + "pump (m and n are integers) 


Each circuit includes a narrowband filter which transmits only fre- 
quencies close to Ms, Onuaps and oi, respectively. For simplicity, let 
the signal and pump circuits be free from ohmic losses. 

Let us omit for a moment the signal source or the pump. Then 
the current flowing through the nonlinear capacitor will not carry 
components at intermodulation frequencies. The current in the idler 





Fig. 124 To the derivation of power relations for a two-stage parametric 
system 
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circuit will be zero, and the system as a whole will behave as 
a reactive network which draws no average power from the source. 

Now we let both the signal source and the pump be present in 
the circuit. In the circumstances, the current through the nonlinear 
capacitor includes a component at an intermodulation frequency; 
this current can complete its path only through the idler circuit. 
The load in the idler circuit draws an average power, and positive 
or negative resistances are inserted in the signal and pump circuits, 
the magnitude and sign of which govern the distribution of power 
between the signal source and the pump. 

This is a closed (self-contained) system and, on the basis of the 
law of conservation of energy, the average powers in the signal, the 
pump output, and the intermodulation frequency are connected by 
a relation of the form 


Ps + Ppump + Pi — 0 (12.50) 


The power averaged over period T may be expressed in terms of 
the energy E dissipated over this time interval as 
T 


P= =I v(t)i(t)dt = fE 

where f is the frequency in Hz. Thus, 

Js Es + fpump Epump + fi Ei = 0 

or, recalling that fi = mf; + nfpump, 

fo (Es + mE) + fpump (Epump + Ej) = 0 (12.51) 


Equality (12.51) must be satisfied identically at any values of f; and 
fpump. This can be so only if 


E, + mE; =0 (12.52) 


By replacing energies with powers, we obtain two important 
equations known as the Manley-Rowe relations: 


Pf, mPi 20 
SMS mf; + nfpump 
nP; 


mfs + nf; pump i 


(12.53) 


Ppump/fpump + 


The Manley-Rowe relations give a simple and easy-to-grasp 
msight into power transformation by multistage parametric systems. 
Let us illustrate this with two typical cases. 
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Parametric up-conversion. On setting m=n=1 in Eqs. (12.53), 
we obtain 


Ps/fs + Pi/ (fs +fpump) = 9 
Ppump/fpump + Pi/ (fs + fpump) =0 (12.54) 


As is customary, let the power dissipated in the load be positive, 
and that supplied by the signal source, negative. From Eq. (12.54) it 
is seen that since Pj>0, then P, «0 and Ppump<0. Thus, if the 
idler circuit of the amplifier is tuned to a frequency fi = fs  fpump. 
both the signal source and the pump will deliver power to the idler 
circuit where it is used up in the load. Since 


Pi- — P; — Ppump 


the power gain factor is 
Kp Pi/ — Ps = 1 fpump/fs = fi/fs (12.55) 


An advantage of the parametric up-converter is the absolute 
stability of the system which will not jump into self-excited 
oscillation at any value of signal and pump power. À disadvantage 
of the circuit is that the output signal has a higher frequency than 
the input signal. At microwave frequencies, this brings about certain 
difficulties during the subsequent signal processing. 

Regenerative parametric amplification. Let m= —1 and n=1, 
which means that the idler (output) circuit is tuned to fi — fpump — 
— fs. The Manley-Rowe relations now take the form 


Py/fs — Pi/ (fpump — fs) = 9 (12.56) 
and 
Ppump/fpump + Pi/ (fpump — fs) = 0 (12.57) 


As follows from Eq. (12.56) now both P; and P, are positive. 
Thus, some of the power drawn from the pump is transferred to the 
signal circuit which is another way of saying that regeneration takes 
place in the system at the signal frequency. The output power may 
be taken off both the signal circuit and the idler circuit. 

Equations (12.56) and (12.57) do not make it possible to find the 
gain factor of the system, because P, contains both the part drawn 
from the devices connected to the amplifier input, and the part 
arising due to regeneration. It should be noted that such amplifiers 
are apt to jump into self-excited oscillation, because, given certain 
conditions, a non-zero power will be developed in the signal circuit 
even in the absence of the signal applied to the amplifier input from 
external circuits. 
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12.4 Nonstationary Dynamic Systems 


Linear dynamic systems containing parametric elements are 
a more complicated form of linear parametric devices. Their models 
may be RC-, RL- or RCL-networks with circuit elements of the 
form R(t), C(t) or L(t). In the general case, such systems can be 
described mathematically, using linear differential equations with 
variable coefficients: 

n Usui n-1 


d d Uout 
anl) tani Ami 


+ ay gw + ag (t) Pout =f (t) (12.58) 
General methods for an analytic solution of such equations, given 
an arbitrary dependence of the coefficients on time, are nonexistent. 
This is why a prominent role is played by approximate methods 
based on the specific behaviour of a particular system. This section 
will examine two nonstationary dynamic systems for one of which 
a rigorous solution can be obtained, whereas the other permits us 
to find with a relative ease the approximate characteristics of the 
output signal of importance to practical applications. 

Free oscillations in a parametric RC-network. Consider a source- 
free RC-network made up of a fixed resistor R and a parametric 
capacitor of capacitance C(t). Initially, the voltage across the 
capacitor is vc(0)= Vo. We set out to find the manner in which vc 
varies for t>0. To write a differential equation for the system, we 
note that the current in the circuit is 


i(t) 2 C dvc/dt + vc dC/dt 


By Kirchhoffs second law, the initial-value problem may be 
stated as 


( RCdvc/dt + (1 + RdC/dt)vc — 0 


12.59 
vc(0) 2 Vo i 


Importantly, if the capacitance were fixed, the initial-value problem 
for the system in question would be stated as 


i RCdvc/dt + vc = 0 


12.60 
vc (0) = V, ( ) 
By comparing (12.59) and (12.60), we note that in the general case 

the differential equation of a parametric system cannot be 
developed by simply inserting the variables R(t), C(t) or L(t) in the 
equation corresponding to a stationary system. 


Ch. 12 Signal Transformations in Linear Parametric Circuits 367 


Consider the specific case of a linearly varying capacitance, when 
C (t) 2 Co +at 
dC/dt — a 


where Co and a are certain constants. 
The differential equation can readily be solved by separating the 





Joi The quantity a has the 

dec =dInvc= — Trak t dimensions of con- 
UC R(Cy + at) ductance 

Hence, 

Inve= — 2 lax =- 2 In (at + Co) + In A 

Or 

vc (t) = A(at + Cy) 1 * ^RYaR (12.61) 


The constant A is readily found from the initial condition 
vc (0) = AC,  * aRVaR Vs 

The final solution of the problem (12.59) has the form 
vc (t) = Vo(1 + at/C,)- 9 * *RY&R (12.62) 


It is useful to compare Eq. (12.62) with the solution for 
a stationary problem for d=0: 


vc(t) = V; exp( — t/RC;) (12.63) 
The plots constructed on the basis of Eqs. (12.62) and (12.63) 


appear in Fig. 12.5. The" parameter a has been taken as 1/R. In the 
circumstances, the capacitance of the capacitor increases by C, over 


A 
Work Problem 9 
Vel Vo 


—— Variable capacitance 


= Fixed capacitance 


t/(RCo) 





Fig. 12.5 Variations in the voltage across the capacitor of a parametric 
RC-network during a source-free discharge. It also shows the curve related 
to a stationary circuit with a time constant t, = RC, 
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the time interval t9 — RC, which is the time constant of 
a stationary circuit. 

Interestingly, the voltage across the parametric system varies at 
a higher rate during the initial time interval, but later the 
exponential (12.63) falls off more rapidly than the power function 
(12.62). 

A tunable-capacitance resonant circuit. Quite a number of 
communication devices, such as spectrum analyzers or scanning 
receivers, make use of resonant circuits made up of an L and a C, 
one of which is made to vary in time by some means, thereby 
varying the resonant frequency of the tuned circuit. 

Consider a tunable resonant circuit under the following 
conditions: (1) The parametric element is a capacitor from which 
the output signal is picked off. (2) There are no losses in the 
resonant circuit. (3) The input signal is supplied by a source of 
harmonic voltage vin(t)= Vincos Wot. 

Recalling that the voltage across an inductor is given by 


d 
Ldi/dt = Em (C dvc/dt + vc dC/dt) 


= LC d? vc/dt? + 2L (dC/dt) (dvc/dt) + L vc (d? C/d£?) 
we derive the following differential equation of the system: 


LC d?vc/dt? + 2L (dC/dt) (dvc/dt) + (Ld?C/dt? + 1) vc = vis (t) 
(12.64) 


If the capacitance varies linearly in time as C(t)— at, then Eq. 
(12.64) can be- simplified as 


aLT d?vc/dt? + 2aLdvc/dt + vc = Vmcos Wot (12.65) 


The linear differential equation thus obtained has two 
distinctions. 

(1) The coefficient of the highest derivative is a linear function of 
time. 

(2) Although, under the assumption made, the circuit is free from 
ohmic losses, the left-hand side contains a term proportional to the 
first derivative of the sought function. Recalling that the analogous 
equation for a stationary resonant circuit has the form 


LC d*vc/dt? + RC dvc/dt + vc = Vmcos Mot (12.66) 


we conclude that parametric variation in the capacitance of the 
resonant circuit is equivalent to the insertion of an amount of 
attenuation. 

Generally speaking, Eq. (12.65) must be supplemented with initial 
conditions defining vc and duc/dt for t=0. The total solution (see 
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Chap. 8) is the sum of a particular integral and the complementary 
function. The particular integral represents the forced (steady-state) 
response of the system, and the complementary function its free 
(transient) response. We will limit ourselves to seeking the forced 
response as being of the greatest practical interest. 

Suppose that in the sense to be defined shortly the capacitance 
C(t) varies slowly. This permits us to speak of the instantaneous 
resonant frequency 


ores (t) = 1/V LC (0 = 1/|/ Lat (12.67) 


At time tọ, when Ore (to) = @), the system is at resonance, and 
the amplitude of the output wave is a maximum. At t < tg and t > 
>to, the output signal has a lower amplitude. 

Since we are interested in the behaviour of the system in the 
vicinity of the resonant point tọ, let us replace approximately the 
coefficient aLt on the left-hand side of Eq. (12.65) with a constant 


aLt, = 1/0% (12.68) 


Now the problem reduces to finding the partial solution of the 
differential equation 


d? vc/dt? + 2aLos dvc/dt + 0% vc = œ Vmcos Wo t (12.69) 
We will seek the solution in the form 
vc (t) = A cos Wot + Bsin Oot (12.70) 


with unknown constants A and B. 
On substituting (12.70) in (12.69) and equating the coefficients of 
the sine and the cosine on* both sides, we get 


A=0, B= Vp/2aLoy 


Thus, over a short time interval which includes the instant when 
the system passes through resonance, the voltage across the 
capacitor is 


velt) z (Vm/2aLoo) sin Wot (12.71) 


The condition for the “slow” passage of a system through 
resonance. The accuracy with which Eq. (12.71) represents the 
actual process improves as the value of a is decreased. The 
constraints imposed on the value of a may be stated in more 
rigorous terms if we take advantage of the following physical 
consideration: The passage of a parametric system through 
resonance should be regarded as slow, if over the period T = 2n/m,) 
the instantaneous resonant frequency @res(t) = 1/y LC (t) changes by 
a substantially smaller amount than cg. 


Since the capacitance 
is assumed to vary 
slowly, the problem re- 
duces to solving a 
differential equation 
with constant coeffi- 
cients 


m many cases of 
practical interest the 
condition of slow pas- 
sage is satisfied 
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The change in the resonant frequency is 


A@res = A@res/dt |i- i; T= — aL@9T/2 = — anLox 


The condition will be satisfied if 
anLog « Wo 
Hence, 


a « L/L = l/tpg 


(12.72) 


(12.73) 


where pg is the characteristic impedance of the resonant circuit 


tuned to resonate at frequency a. 


Example 12.5. T he characteristic impedance of a resonant circuit is 
Po = 500 Q. The tuned-circuit capacitor changes in value at the rate 


a—-10 ^S$—10^* Fs !—100 pF ys^! 


Investigate the passage of the system through resonance. 

Taking advantage of the inequality (12.73), we see that the 
condition for the slow change of the capacitance is satisfied. On the 
basis of (12.71), we find that at resonance the amplitude of the out- 
put voltage is ten times the amplitude of the input signal 


1/2aLo, = 1/2ap, = 10 





The impulse response and the frequency 


response of 


a nonstationary dynamic system. Any linear system, be it stationary 
or nonstationary (parametric), obeys the principle of superposition, 


superposition integral. 


>. : and so it may be investigated by recourse to the Duhamel 


The impulse response of a parametric system, h(t, t,) is defined as 

the response to the delta-impulse applied to the input at time t,. 

m, Whereas for a stationary system the argument of the impulse 
f response is solely the difference, t — t,, between the instant of 
observation and the instant when the excitation is applied, for 

a nonstationary system this relation may take an arbitrary form. 

Still, a physical system cannot give an output in advance of the 


~ 


t 


input signal, so for a physically realizable system we always have 


1 that 
Variations in the shape h(t, tı)=0 for t«t, (12.74) 
of the impulse respon- If we know the impulse response h(t, t,), we can readily define 
se of a parametric the output signal of a nonstationary dynamic system as 
network with time . 
Vout(t)= | vin(t;) h(t, t,) dt; (12.75) 
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The Fourier transform of the impulse response in terms of the 
variable t, is called the frequency response of a parametric network: 





K(jo, t)= f h(t, t)exp( —jot;)dt, (12.76) 


If Si(c) is the spectrum of the input signal, then Eq. (12.75) in 
frequency representation takes the form 


1 oo 
vout(t) = 5— I Sin(o) K (jo. t)exp(jot) do (12.77) 


A distinction of the frequency response (12.76) from the similar 
function characterizing a stationary system consists in that it has an 
additional argument- the observation time t. 

Actually, Eq. (12.75) or (12.77) is a formal solution because the 
evaluation of the impulse response h(t, t,) or, which is the same, of 
the frequency response K (jœ, t) involves an analysis of an exact 
model of the system, that is, solving the corresponding differential 
equation. Yet, this device is frequently employed when a complex 
real network has to be replaced with a maximally simplified 
mathematical model. For example, a parametric system may have 
the frequency response 


K (jo, t)= z(t) (12.78) 
which is independent of frequency. The corresponding device 
operates as a multiplier or, an amplitude modulator. When it is 
driven by an input wave of the form 

Vin(t) = Vo cos Wot 

its output signal is an AM wave 


Vout(t) = Voz (t) cos Wot (12.79) 


Another important example is a nonstationary system operating 
as a frequency or phase modulator. Here 


K (jo, t) = exp [jz(t)] (12.80) 
and so, under the conditions defined above, the output signal 


Vout(t) = Vo cos [oot + z(t)] (12.81) 


is an angle-modulated wave. 


a 

A distinction of the 
frequency response of 
a parametric network 


a 

The simplifications as- 
sumed in describing 
nonstationary dynamic 
systems 
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In most real cases the 
signal is both ampli- 
tude and phase modu- 
lated at random 
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12.5 Response of Parametric Systems with Random 
Characteristics to Harmonic Signals 


It is of great interest, both theoretically and in the applied sense, 
to investigate the response of a system whose parameters vary in 
time at random. In the simplest case, this may be a random 
instability in the frequency response function of a device, leading to 
fluctuations in the amplitude at the output. In a more complicated 
situation, one may be concerned with the propagation of signals in 
various media, say, in the Earth’s ionosphere subject to variations 
in the refractive index. Here the received signal is corrupted by 
a random angle modulation because the shift of the signal phase 
along the propagation path is a random time function. 

A detailed investigation of the statistical characteristics of the 
signals at the output of linear systems with randomly varying 
parameters is an extremely complex task [14, 15]. In this section, 
we will only dwell in brief on two of the simplest problems of the 
kind. 

Random amplitude modulation. In investigating a parametric 
system whose frequency response has the form defined in (12.78), we 
assume to know the mean mz and the autocorrelation function 
K-(t) of the stationary random process Z(t) which defines the form 
of modulation. 

By resort to correlation theory, we will investigate the statistical 
characteristics of the process Y(t) at the output of a system, 
assuming that the input signal is a harmonic wave, V cos @pt. Since 
the realization of the output signal is 


y(t) = Voz(t) cos Wot 


it follows that my=y=0. 
The autocorrelation function of the output signal is 





K,(t) = y(t) y(t + x) = Voz(t) z (t + x) cos Wot - cos wolt + T) 
(12.82) 
Since 





COS Wot COS Wo(t + t) = 1/2[ cos Mo(2t + T) + cos ost] = 1/2cos Wot 
then 
K,(t) = (V2/2)z(t)z(t + x) cos Wot 
By definition, the mean product is 
z(t)z(¢+t)=K,(t) + m3 


Hence, the final relation connecting the autocorrelation function of 
the output signal and the random frequency response z(t) takes the 
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form 

Ky (t) = (V$/2) [Kz (1) + m2] cos qx (12.83) 
and the variance of the output random process is 

o? = (Ve/2)(o + m?) 


The form of Eq. (12.83) is an indication that if the realizations 
z(t) vary more slowly than the input signal, the output wave is 
a narrowband random process. It is to be noted that if m; z 0, then 
Ky(t) does not tend to zero for 1 oo. 

To get insight into the physical significance of the above 
property, let us take the inverse Fourier transform of K (1), that is, 
find the power spectrum of the process Y(t): 


W,(@) = f Ky (t)exp( —jot)dt 


202 


x 


|. Rt) cos aet cos ox dt 


x 


2 x 


oz 
2 





| coswotdt 
— 00 


By simple rearrangement, we can re-write the above equation as 





Vio . © 
W,(@) = 2 —[ f Rz(9cos(og + a) tdt 


+ f R; (1) cos (o + ©) tdt] 


<n [3(@ + @,) + 5(o — eJ] (12.84) 

Equation (12.84) tells us that the power spectrum of the process 
at the output of a random amplitude modulator contains two 
components: a continuous part due to random fluctuations in the 
amplitude, and a discrete part which represents the response of the 
system to the unmodulated carrier wave; the spectrum of the 
discrete part corresponds to two delta-functions in the frequency 
domain. The contribution of the discrete part increases as m 
becomes progressively greater than o2. In approximate form, the 
autocorrelation function and the power spectrum for the case in 
question are plotted in Fig. 12.6. As is seen, the continuous part of 
the spectrum is represented by two smooth curves with maxima at 
points © = +@,. 

The envelope of the output signal. If Z(t) is a slow process, it is 


a 

The power spectrum of 
a signal in the case 
of random amplitude 
modulation 


The envelope 
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Envelope 


Vout 


a 
The variance of the 
signal remains con- 
stant in the case of 
random angle modula- 
tion 


Part Two. Circuits 


Ü 
(b) 





Fig. 12.6 Characteristics of the signal at the output of a random amplitude 
modulator: (a) autocorrelation function; (b) power spectrum 


legitimate to think that the instantaneous value of the physical 
envelope at the output of the system is 


V,(t) = | Voz (2) 


The modulus sign indicates that the amplitude detector producing 
this envelope at its output is insensitive to the phase of the high-fre- 
quency carrier. 

As is seen from (12.85), the envelope of the narrowband process 
at the output of a parametric system with a fluctuating frequency 
response z(t) may be obtained as a result of a nonlinear lag-free 
(zero-memory) transformation of the random process z(t) in an 
imaginary device with a piecewise-linear characteristic vout- | yvinl. 
The mean, the variance, and the autocorrelation function of the 
envelope can be calculated by the techniques set forth in Chap. 11. 

Random angle modulation. Now let us turn to a random 
parametric system whose frequency response has the form defined 
in (12.80). Going through the steps taken in our investigation of 
a random amplitude modulator, we can develop a general 
expression for the autocorrelation function of the output signal 
when the system is driven by a harmonic excitation: 


Ky(1) = V$cos [ost + z(t)] cos [oo(t + x) + z(t + 1)] 


(12.85) 








= (V$/2) {cos [2@ot + ost + z (t) + z(t + x)] 





+ cos [ost + z (t + t) — z(t)]} (12.86) 


On averaging, the first term in the braces will obviously vanish, and 
so 


Ky (t) = (V6/2) cos (aot + z, — 2) 


= (V2/2)cos(z;— z)cos og: — (Vo/2)sin(z; — z)sinet — (12.87) 


(To simplify the expression, we have omitted the argument of the 
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function z(t).) 
If x0, then 


lim cos (z; — z) = 1 


and 
lim sm (Zz: — z) = 0 


so that the effective power in the signal, that is, its variance 07 = 
= V2/2 is the same as the power in the harmonic signal of 
amplitude V, and at a constant frequency. 

Equation (12.87) gives a complete description of a signal 
subjected to random angle modulation in terms of correlation 
theory. Among other things, it tells us that if the process Z(t) is 
formed by realizations which are slow in comparison with 
harmonic waves at frequency og, then the output signal of 
a random phase modulator is a narrowband process with a centre 
frequency 0. 

Angle modulation by a normal random process. In order to 
make use of Eq. (12.87), we should find the mean of its 
trigonometric functions with a difference argument. This can be 
done on the basis of a bivariate probability density function p(z:, 
z): 


cos (Z: — z) = ff cos(z,—2)p(zx, z)dz,dz 


sin (z: — z) = ff sin (z+ — z)p(Zzz, z) dz«dz 

It may prove difficult to evaluate such integrals if the function 
D(z:, z) is arbitrary. If, however, Z(t) is a Gaussian process, an 
elegant technique suggests itself, immediately leading to the final 
result. It is based on the use of a bivariate characteristic function 
for a Gaussian process (see Eq. (6.32)): 


O(v,, 02) = exp [j (zzv + zv;)] 





l 
= exp [jmv + v;) — 39: (v? + 2Rz(x) v,v; + v2)] 


á 


(12.88) 


Since 


exp [j (z: — z)] + exp | -j E: -2)] 
2 








cos (Z; — z) = 


then, by virtue of Eq. (12.88), 





cos (z, j-;[eu. 1)- 9(— 1, 1)] (12.89) 


|| 

Averaging with the aid 
of the characteristic 
function 
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On putting for definiteness m; — 0, we have 
o, —1)-G0(—1, 1)=exp{ — o2 [1 — R£()]) 


Therefore, 
cos(z, — z) = exp { — o2 [1 — R(t) ]} 


sin(z; — z)— 0 
Substituting the above results in (12.87) yields the final expression 


for the autocorrelation function of the signal produced from 
a harmonic wave by Gaussian angle modulation: 





2 


Ky(t)= “exp {— 07 [1 — Rz(t)]} cos Mot (12.90) 





Qualitatively, the above function is analogous to that found 
earlier in the analysis of random amplitude modulation. Therefore, 
the conclusion that the power spectrum contains two components, 
continuous and discrete, may fully be carried over to the present 
case. Analysis [15] shows that for o7>1 random angular 
modulation is broadband. The discrete part of the spectrum 
practically disappears, whereas the continuous part in the vicinity 
of frequency @, is described by a Gaussian function of the form 

— (o — oy 
= exp = 
c. R0  2oi[- R:(0)] 

The effective bandwidth 


Awer = |/21 6: |/ — Rz (0) (12.92) 


increases with an increase in both o; and — Rz(0) proportional to 
the time rate of change of the modulating function. 


mlo) = V2 |/n/2 (12.91) 





Summary 


<*> If the impedance of a lag-free (zero-memory) parametric element periodically varies in 
time, the spectrum of the output signal contains, generally speaking, an infinite 
number of intermodulation products at sum and difference frequencies of the form 
Os + koc (k=0, +1, +2, ...). 

QX A resistive parametric element can be implemented by applying the sum of a small 
message signal and a large control signal to the input of a lag-free nonlinear one-port. 

<* Frequency conversion consists in translating the signal spectrum from the neighbour- 
hood of the carrier frequency into the neighbourhood of the intermediate frequency 
without any change in the form of modulation. 
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< In synchronous detection, the signal frequency is the same as the local oscillator 


frequency. 

4*7 Reactive parametric elements can transfer some of the pump power to the circuits 
containing the useful signal. 

4X Given appropriate phase relations, a parametrically controlled capacitor can initiate 
oscillations in an LC resonant circuit. Connection of such a capacitor is equivalent to 
the insertion of a negative conductance in the resonant circuit. 

<x” Parametric amplifiers may be single-stage and double-stage. In the latter case, 


$ 3s 3 8 


a parametric amplifier includes an idler circuit tuned to one of the intermodulation 
frequencies. 

Power relations in a multistage parametric system are described by the Manley-Rowe 
relations. 

Parametric dynamic systems are described by differential equations with variable 
coefficients. 

The frequency response of a linear parametric system is a function of both frequency 
and time. 

In the case of random amplitude modulation the spectrum of the output signal 
contains both a continuous and a discrete component. 

If, in the case of angle modulation, the modulating function is a realization of 
a normal random process, the autocorrelation function of the output signal may 
be stated in terms of the characteristic function of the signal at the modulator 
input. 


Review Questions 


I: 


Mew 


What is the fundamental difference between the spectra of the currents flowing in 
a resistive parametric one-port and a nonlinear one-port? Assume that both elements 
are driven by a harmonic excitation. 

Draw up a block diagram of a superhet receiver. What is the image frequency in 
reception? How can the ambiguity in receiver tuning be resolved? 

Define the conversion transconductance. 

List the merits and demerits of a synchronous detector. 

Is it possible to excite a tuned circuit with the aid of a parametric capacitor whose 
capacitance varies in time at a frequency equal to the resonant frequency of the tuned 
circuit? 


. Describe the physical principle underlying the operation of the varactor. 


Name the phenomena accompanying the operation of a single-stage parametric amplifier 
in the asynchronous mode. 
What is the advantage of double-stage parametric amplifiers? 


. Why is it that parametric amplifiers have a low level of internal noise? 
. Formulate the condition for the “slow” passage of a parametric tuned circuit through 


resonance. 


. Give an example of a physical system in which the input signal is subjected to random 


amplitude modulation. 


. List the salient features of the signal spectrum produced by random angle modulation of 


a harmonic carrier. 
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Problems 
1. The parametric conductance is varying 
in time as 
G(t) 2107? 5 x 107 *cos10?t - 3 x 
x 107 * x cos2 x 105: 


The excitation is a voltage 

v(t) = 5cos 106: 

Find the amplitudes and frequencies of all 
the current components. Plot the spectral 
diagram. 

2. A lag-free nonlinear resistor has the 
current-voltage characteristic (mA) 


i(v)= 5 + 2.5v + 1.5v? 

The voltage (V) applied to the resistor is 
v(t) = 3 + 0.5 cos Ot 

Derive the equation defining the time 
dependence of the dynamic trans- 
conductance. 

3. There is a frequency converter built 
around a transistor whose characteristic is 
given by 
] 20(vge — 0.5) for vge > 0.5 V 
ic= 
"B for vee < 0.5V 
In the “no-signal” condition, the base is fed 


with the sum of the bias voltage and the 
local-oscillator voltage (V): 


VBE = 0.2 + 0.7 cos Mot 
Find the conversion transconductance. 


4. The capacitance of a parametric 
capacitor (pF) varies in time as 


C (t) = 200 + 80cos (10?t + 1/4) + 40cos 5 
x 105t 

The voltage applied to the capacitor (V) is 

v = 30cos 5 x 10°t 


Find an analytic expression for the current 
in the capacitor. 

5. The inductance of a tuned circuit is 
0.5 mH, the average capacitance is C4 — 


— 750 pF, the tuned-circuit loss resistance is 
120. The tuned-circuit capacitance varies 
stepwise by the same amount in either 
direction from the mean value. Find the fre- 
quency at which the  tuned-circuit 
capacitance should be varied and between 
what limits for the resultant Q of the tuned 
circuit to be Q — 300. 

6. Find the Q-factor of a tuned circuit 
whose inductance is 100 uH and whose loss 
resistance is 15 Q. The tuned-circuit capa- 
citance (pF) is varied in time as 


C (t) = 150 + 5cos 1.63 x 107t 


7. The capacitance (pF) of a parametric 
capacitor connected in a tuned circuit is 
varied in time as 


C (t) = 300 + 20cos 5 x 10°t 


Find the inductance and the Q-factor at 
which the system will be excited 
parametrically and the amplitude of 
oscillation will build up without bound. Is 
the solution thus found the only one? 

8. A single-stage parametric amplifier has 
been built to amplify at a frequency of 120 
MHz. The amplifier contains an inductor of 
0.6 pH; the tuned-circuit Q-factor is 35. 
Find the frequency at which the tuned- 
circuit capacitor should be varied and 
between what limits for the gain of the 
system to be 15 dB. 


Advanced Problems 


9. Derive the expression defining time 
variations in the free response of 
a parametric RC-network whose capacitance 
varies in time as 


C (t) 2 Co + Cmcos Wet 


where Gc is the frequency of the control 
signal. 
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10. Find the impulse response of 
a parametric RC-network whose capacitance 
varies in time as 


C (t) = Co + Cmexp( — t/t) a (t) 


where Cy, Cm, and t are constants. 


11. A source of d.c. voltage V, is 
connected at time t=0 to a series 
RC-network for which R (t) = Ro exp(at) and 
C (t) 2 Cp exp( — at). Derive equations 
defining variations in vg and vc. Analyse 
the cases for à» 1/R Cy and a x 1/RoCo. 


E 
Circuit synthesis yields 
more than one result 


Chapter 13 


A Basic Theory 
of Linear Circuit Synthesis 


Circuit theory may be divided into two broad areas closely 
related to each other, namely analysis and synthesis. The objective 
of analysis is to find the external characteristics of a system whose 
structure is specified in advance by giving its schematic diagram. 
The objective of synthesis is diametrically opposite. We are given 
an external characteristic, say, the frequency response function, and 
we are to find the circuit structure implementing the given 
characteristic. 

In contrast to analysis, circuit synthesis will usually yield more 
than one result. Therefore, it is additionally required to find, from 
among the several structures possessing the same specified 
properties, that which is optimal in a particular sense. The criteria 
of optimality may be many and diverse. For one thing, it is always 
desired that the circuit being synthesized should contain the least 
possible count of circuit components. In other cases, it may be 
desired that the circuit be sensitive only slightly to the choice of 
element values. 


13.1 Analytical Properties of the Driving-Point Impedance 
of a Passive Linear One-Port 


Recently circuit synthesis methods have come to play an 
especially important role with the advent of computer-aided circuit 
design systems. A whole range of synthesis procedures, sometimes 
extremely sophisticated, have been developed, with which the reader 
may acquaint himself on his own [27. 30]. This Chapter will be 
concerned with two very simple problems of synthesis, namely the 
structures of linear one-ports and two-ports made up of elements 
such as R, L, and C. In all cases, the basic data for the synthesis 
will be stated in terms of frequency characteristics. 

It is to be noted that the synthesis procedures set forth here can 
be applied not only to electric or electronic circuits, but also to any 
linear systems which can be modelled as circuits. 

For a network synthesis procedure to be informative, we should 
above all establish the criteria that could be used to predict the 
realizability of a network. This section will be concerned with the 
most important properties of the driving-point impedance of 
passive linear one-ports. 

Location of poles and zeros. Let V(p) and I(p) be the Laplace 
transforms of the voltage across and the current in a one-port. 
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Their ratio 
Z (p) = VipyI(p) 


is the driving-point impedance defined over the entire complex-fre- 
quency plane. Also, as can be recalled from Chap. 8, 


dg D^ + ay  ,p" 1+...+a,p+ dg 








Z(p)= = 
V b, p^ + b, p" | +...4+b,;p + bo 
= Zo(P — 21) (p — za)...(p — zm) (13.1) 
(p — pi)(p — p3)..4p — po) 
The poles pi, P2, .... Pn and the zeroes z,, Z2, .... Zm of the 


driving-point impedance of a one-port should be such that the 
system in question which, by the statement of the problem, does 
not contain any sources continuously feeding energy. will be stable. 

Let the terminals of the one-port be open (the open-circuit or 
no-load condition) and a voltage exist between them. Since no 
current is flowing through the one-port, the behaviour of the 
one-port can be described by the characteristic equation 


I(p)/V(p) = 1/Z(p) = 0 (13.2) 


whose roots are the poles of the driving-point impedance Z (p). Any 
voltage between the terminals of a one-port which is in the 
open-circuit condition and is storing an amount of energy in its 
reactive elements is described by 


Vo.c(£) = A, exp(p,t) + A;exp(pzt) + ... + Anexp(pst) 


where the A;s are the coefficients found from the initial conditions. 
The condition for an open-circuited system to be stable is defined 
by the inequality 





Re(p) <0, i=1, 2, .. n (13.3) 





Similarly, if we examine the same one-port with its terminals 
short-circuited (the short-circuit condition), when V(p)=0, but 
I(p) #0, a second characteristic equation can be derived 


V(py/I(p) = Z (p) = 0 (13.4) 


Its roots are the zeros of the driving-point impedance; they should 
be such that 





Re(z) «0, i=1, 2. .... m (13.5) 
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Thus, both the poles and the zeros of the driving-point 
impedance of an absolutely stable passive linear one-port lie solely 
in the left-hand half of the complex p-plane. Also, the roots are 
always either real or form complex-conjugate pairs. 

The limiting idealized case is a purely reactive one-port. Since it 
is free from ohmic losses, its poles and zeros are always located on 
the imaginary jo-axis. 

The number of poles and zeros. Further information about the 
behaviour of the function Z (p) is given by the following important 
theorem: The number of poles for the driving-point impedance of 
a passive one-port cannot differ from that of zeros by more than one. 

By way of proof, let us write the driving-point impedance at 
some physical frequency œ as 


Z (jo) 2 | Z (jo) | exp arg Z) (13.6) 


So that Eq. (13.6) can be depicted graphically, we should put p= 
— jo in Eq. (13.1) and draw vectors from all poles and zeros so that 
their tips converge to the selected point on the imaginary axis, 
representing the current frequency. Then, as can readily be seen, the 
phase angle of the driving-point impedance is 


m n 


argZ — 5», Qu — 2, Opi 
k 1=1 


which means that the poles decrease, and the zeros increase the 
resultant phase. 

On the average, a stable passive one-port always draws power 
from external sources at any frequency. This implies that the real 
part of the driving-point impedance, Z(jo) is positive. Hence, 


— q/2 Sarg Z < n/2 (13.7) 


Let the frequency œ tend to infinity. Then both the phases of the 
poles and the phases of the zeros will tend towards 1/2. Thus, 


lim argZ = (m — n)n/2 (13.8) 
o> o0 

Therefore, the numbers m and n may be either the same or differ by 
unity. 


In circuit theory, the function Z(p), analytic in the right-half 
plane and having a nonnegative real part on the imaginary jo-axis 
belongs to a special class of positive real (p.r.) functions. 

More tangibly the above theorem may be stated like this: As the 
frequency tends to infinity, any passive network can behave either 
as a resistor, if the degree of the numerator in Eq. (13.1) is the same 
as that of the denominator, or as a capacitor, if the degree of the 
denominator is greater by one than that of the numerator, or, 
finally, as an inductor if the converse is true. 
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Relation between the real and imaginary parts of the 
driving-point impedance. It is an easy matter to verify that at real 
frequencies o the driving-point impedance of a one-port made up of 
a resistor R and an inductor L connected in parallel is defined by 

. R (jo) + jX (jo) o’ RP PP oLR? 

= R(jo w) = I 
Z jo) DM Reo (mRrgp 


It is to be noted that the values of R and L enter both the real and 
the imaginary part of the driving-point impedance. 

Networks composed so that each of their elements affects both 
the real and the imaginary part of Z(jo) are usually called 
minimum-impedance networks. For this class of networks, there is 





a unique relation between R(jo) and X(jo) for real values of 
frequency. 

Let us fix the frequency o and investigate the integral 

Z (p) 

—*— dp = 0 (13.9) 
f p — jo p 


taken over a closed contour in the right half-plane. The pole arising 
for p = jo is passed around along the semi-circle C, of small radius. 
The integral along the infinitely large arc C, is negligible because 
Z(p) is analytic to the right of the imaginary axis. Therefore, 


i Z(6)d5 pid? 20 (13.10) 
E-o ı P—JO 


-x 





The integrand Z (p)/(p — jo) in the vicinity of the pole p = jœ tends 
to infinity uniformly. Therefore by Cauchy’s residue theorem, 
noting that arc C, is a half-circle and the residue at the pole is 
Z(jo) we may re-write Eq. (13.10) as 


oo Z i= dé 
f AUIS 5 zip =0 (13.11) 
Ze §-@ 
Hence, on splitting into the real and imaginary parts, we get 
: | t? R(j$5d& 
X(o)- — [ 25. 
Tio 5—0 
(13.12) 
: 1*7? X(j9d 
R(jo) = — I X Gd 


tm, 0—6 


Thus, the real and imaginary parts of the driving-point 
impedance for the class of one-ports in question are related by 
a Hilbert pair. 
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Example 13.1. There is a parallel RC-network for which 


R 
Rio 
(o) — T oXRCY 
and 
— oR?C 
7 Gales e 
(2) = SIRO? 


Verify that, if the real 


(13.13) T 


(13.14) | : 


part of the driving-point impedance for this 


network is known, we can recover the imaginary part by means of 


Hilbert transformation. 
On setting x = 1/RC 


X (ja) = f 


and inserting (13.13) into (13.12), we get 


dé 
; (13.15) 





RRC? "o (a? + 
The integrand can be 
1 a6 + 


EÉ- o) 
expanded into partial fractions: 
b ë 


OFE tE i-a 


where 





, C= 
o? + o? 


The individual integrals have the form 


= Edi e di 


e f= 








= n/a 
© 2 aE? 


On substituting them in (13.15), we obtain Eq. (13.14), which was to 


be proved. 





-L 
Cin 


A 
Solve Problem 1 


The result thus obtained is very important in assessing the 
behaviour of the driving-point impedance of a one-port along the 
entire frequency axis. As an example, we may quote a theorem [36] 
which establishes that the driving-point impedance of any network, 
such as an amplifier, whose driving-point capacitance is Cin, 
satisfies the inequality 


f Rindo < (7/2)/Cin (13.16) 
0 


On this ground we may state, for example, that an amplifier with 
a flat driving-point impedance Rin=1 MQ over the frequency 
interval 0-1 MHz, with the input capacitance being Cin = 10 pF, is 
unrealizable in principle. 

The driving-point impedance of reactive one-ports. The frequency 
properties of the driving-point impedance of purely reactive 
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Fig. 13.1 Typical plots of functions X (jo) for two purely reactive networks 


one-ports are concern of Fosters theorem [27], an important 
proposition in circuit theory. It is stated as follows: If Z(jo) — 
= jX (jo), then the reactive impedance is a nondecreasing function, 
that is, dX/do > 0. The frequency dependence of the driving-point 
impedance for some reactive one-ports is plotted in Fig. 13.1. 

As a corollary to the Foster theorem, we may state that (a) points 
p=0 and p=oo are the singularities (zeros or poles) of the 
driving-point impedance; (b) on the jw-axis, the poles and zeros 
alternate. 

In synthesizing an electric network, it is mandatory first to 
analyse the function Z(p) for its properties so as to discard the 
obviously unrealizable characteristics. 
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A 
Work Problem 2 


jw Example 13.2. We are given the function 
Py 234 
gy PU t (13.17) 
zy 4.9 4 
2; which has three zeros: z, — 0, z, —j and z4 — —j; and two poles: 
cig— p, —2j and p,— —2j. 
The singularities are located on the imaginary axis (which is 
23 typical of reactive networks). The number of poles is by one smaller 
than the number of zeros. Nevertheless the network described by 
D, the function in (13.17) cannot be realized because it violates the 


requirement that the singularities should alternate on the jo-axis. 








13.2 Synthesis of Passive One-Ports 


The classical problem of one-port synthesis can be stated as 
follows: We are given the driving-point immitance of the desired 
network, which may be its driving-point impedance Z(p) or its 
driving-point admittance Y(p) that meets all the requirements 
placing it among the functions of physically realizable and stable 
one-ports. We are to synthesize the network answering the specified 
driving-point immitance. 


e 
The problem of one- 
port synthesis 
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The initial specification does not tell us anything about the struc- 
ture of the desired network. Therefore, we should guess some struc- 
ture in advance. The synthesis procedure does not yield a unique 
result: it may well so happen that one and the same driving-point 
immitance may be realized in more than one way. If so, preference 
is given to the design which is optimal in some sense, for example, 
one having the lowest count of circuit elements. 

The rationale of network synthesis. Any method of one-port 
synthesis is based on the fact that the specified driving-point 
immitance, Z(p) or Y(p) is subjected to a series of consecutive 
simplifications. At each step, we single out a particular expression 
which can be uniquely identified with a particular circuit element. 
The nature of these transformations is fixed in advance by the 
network structure we have chosen. The simplest structures we are 
going to consider are shown in Fig. 132. 





AZ Z> Z Z2 
eH} -- 
Zn 
£g 
(a) 
Y,| |Y2 Yn Yi Yn 
M —À 
(b) (d) 


Fig. 13.2 Some of the one-ports being synthesized 


It is an easy matter to see that in case (a) 
Z(p)=2Z,+Z,4+...+Zn (13.18) 


and in case (b) 
Y(p)= Y, + Y; +... + Y, (13.19) 


The one-ports shown in Fig. 13.2c and d are known as ladder 
networks. Here, for case (c) 


Z(p)=Z, + 


(13.20) 
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and for case (d) 


Yi) = Y, + 
Z,+ 
tT Ye + 
1 
i (13.21) 
Zn T Y 
Yn 
The expressions in (13.20) and (13.21) are called continued fraction 
expansions. 


By identifying the components Z,, Z,,.... Znand Y,, Y,,.., Y € 
with specific physical elements we solve the task of one-port Continued fraction ex- 
synthesis. pansion 
Synthesis of reactive one-ports. We will dwell upon the basic 
techniques used in the synthesis of linear passive one-ports, taking 
as an example purely reactive networks made up of Land C. For 
this case, it is rigorously shown [27] that any realizable 
driving-point immitance, Z(p) or Y(p), may be represented as the 
driving-point immitance of the networks shown in Fig. 13.2. The 
reactive one-ports shown in (a) and (b) are known as Foster type @ 
networks, and those in (c) and (d), are called Cauer ladder networks. Foster and Cauer net- 
Let us turn to a concrete example. works 








Example 13.3. The driving-point immitance is given as 
(p? +1)(p? +25)  p*-26p +25 
p(p +4) p>+4p 
Synthesize a network having the above driving-point impedance by the 
Foster (or partial fraction expansion) method. 
The direct division of the numerator into the denominator in 
(13.22) identifies the first network element: 
22p? + 25 
p? + 4p 
which is an inductance of 1 H. (Here and elsewhere the network 
element values are chosen to make the calculations easy to follow.) 
The function Z'(p) can be simplified by expanding it into partial 
fractions: 
Zp) = 25 js 63p/4 25 
P dp px4 4p 
The first term on the right-hand side represents a capacitor of 


4/25 — 0.16 F capacitance. 
In order to identify the last network element associated with 


(13.22) 





Z(p)= 





Z(p)=pt -ptZ() 





+ Z"(p) 
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Z'(p) it is advantageous to change to the driving-point admittance 


2 

" pod 4 16 
Y"(p) = 1/Z2"(p) 2 ——— = —— p+ - 

DIE 7 t Bp 
which represents a parallel combination of a capacitor of 4/63 
F capacitance and an inductor of 63/16 H inductance. 

The final step is to draw up a schematic diagram which 
implements the specified driving-point impedance: 





A 
Solve Problem 3 


1 4/25 


63/16 
udi 
a ———— 


In order to synthesize a reactive one-port by the Cauer (or 
continued-fraction expansion) method, the specified driving-point 
immitance should be expanded into a continued fraction series. The 
procedure leading to this form stems from the very structure of the 
fraction. It 1s called the "divide and invert the remainder" process. 





Example 13.4. Synthesize a network having the driving-point 
impedance defined in (13.22) by the Cauer (continued-fraction 
expansion) method. 

We divide the numerator into the denominator, beginning with 
the highest degree: 


3 +4 
pt + 26p2 4.25 P+ P. 
- p (13.23) 
p* ES 4p? 
22p? 4.25 


The quotient is the first network element which, as in the Foster 
type network, is a series inductance of 1 H. 


On writing 
1 
Z (p) = p + — ~ 13.24 
(p)=p Fid ( ) 
22p? +25 


we see that in (13.23) the denominator must be divided into the 
remainder-this is the inversion of the remainder. From this step 
on, division and inversion alternate: 


Divide: Invert the remainder 
3. 2 2 25 63 
p^ + Ap|22p* + 25 i 2p +25 P. 
List — 2p y Mp 
22 22 z5 484p 
63p 63 


A 
Work Problem 4 
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Divide 
63p |25 


22 63p 
550 


389 


Combining the results, we can write the continued fraction 


expansion for Z (p) as 








Z(p) = pt 
p-p FAM j 

22 384 a l 

6 63p 

550 


(13.25) 


which can be identified with the following Cauer ladder network: 


1 484/63 


1/22 


The two previous examples demonstrate that one-port synthesis 
does not yield a unique result. In fact, we can synthesize one more 
network having the same driving-point impedance by the Cauer 
(continued-fraction expansion) method, if we begin division with the 
lowest, rather than the highest degrees of the polynomials. 





Example 13.5. Synthesize a network whose driving-point impedance 
is defined by (13.22), using the Cauer ( continued-fraction expansion ) 
method and beginning division with the lowest degrees of the 


polynomials. 
On writing 
25 + 26p? + p* 


Z — 
(p) rege 





dividing and inverting the remainder, we get 


£ 25 1 
£09 - 4p + 16 i 
79p * 6241 , Tp 


252p 63 








(13.26) 
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The above continued-fraction expansion gives us a reactive 
one-port arranged as shown below: 





79163 


The Cauer method involving division and inversion of the 
remainder is convenient for computer-aided network synthesis. It 
permits a large number of variant techniques. For example, having 
begun the division with the highest degrees, we may reverse the 
order of powers during the subsequent steps. 





e 
Canonic networks 


® 
Darlington’s theorem 


Concluding remarks. Networks giving the minimum number of 
elements for a specified driving-point immitance are sometimes 
known as canonic networks. With reference to reactive one-ports it 
has been proved [27] that both the Foster and the Cauer forms 
possess this property. If N is the number of pairs of singularities 
(poles and zeros) of the driving-point immitance, other than zero 
or infinity, a canonic network contains N +1 reactive ele- 
ments. 

In practical synthesis it should be remembered that the expansion 
of Z(p) or Y(p) into a sum of partial fractions or continued 
fractions may produce negative coefficients. This implies that the 
adopted procedure leads to a nonrealizable network and that 
a different technique should be used. In the Cauer method, for 
example, it may prove advisable to begin division with the lowest 
rather than the highest degrees. It may so happen that in 
synthesizing an RLC-network of the general form none of the 
methods presented here can yield an acceptable result. This implies 
that the driving-point immitance involved cannot be realized in any 
of the proposed simple structures and recourse must be had to 
more complex forms such as described in [27]. What we may only 
say is that the desired network does exist, because, as follows from 
Darlington's theorem (of fundamental significance to circuit theory) 
[28], any physically allowable driving-point function can be 
realized as the driving-point impedance or admittance of some 
purely reactive passive four-terminal (two-port) network loaded into 
a single resistor. 

The search for suitable structures is the most crucial step in 
network synthesis. It commands special attention when developing 
an algorithm for computer-aided network synthesis. 
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13.3 Frequency Characteristics of Two-Ports 


A four-terminal (or two-port) network may be visualized as 
a black box with two pairs of accessible terminals (two ports), one 
pair (or port) being its input, and the other pair (or port) its output. 
In operation, the input port is connected to a signal source, and the 
output port is connected to a load impedance Zz 

It is presumed that the reader has a previous knowledge of 
two-port analysis methods as they are explained in a course on 
circuit theory. This section will be concerned only with some points 
essential to two-port synthesis. 

Matrix notation. A very important property of a linear stationary 
two-port is that the four complex amplitudes V,, I,, V, and I, are 
connected by two linear algebraic equations at any frequency of the 
excitation. If we choose any two of them as independent variables, 
the remaining two will be defined in their terms. This provides 
a basis for the matrix description of linear two-ports [25]. For 
example, one frequently uses the transmission (transfer or ABCD) 
matrix, taking the output voltage and the output current as the 
independent variables. Then, 


V, — AV, - Bl, 





(13.27) 

I, 2 CV, 4 Di, 
The coefficients A, B, C, and D have different physical dimensions 
and can be determined from open-circuit and short-circuit tests. 
Transmission matrices are especially convenient in describing 
a cascade connection of two-ports, because the resultant matrix is 
the product of the indivsdual matrices. 

If the matrix of a two-port and its load impedance are known in 6 
advance, we can find the so-called network functions such as ^ Network functions 

(a) the driving-point impedance Zin = V,/I, ; 

(b) the transfer impedance Z; = V/I,; 

(c) the voltage-ratio transfer, or frequency response, function 
K (jo) = V,/V,. 

In the general case, the network functions are frequency- 
dependent and characterize the frequency properties of two-ports in 
a variety of problems. Any network function can be expressed in 
terms of the members of the two-port’s transmission matrix and in 
terms of the load impedance. Thus, by dividing the respective sides 
of Eqs. (13.27), we find that 


Zin = (AZL + B)/(CZL+ D) (13.28) 
Similarly, the voltage-ratio transfer function is found to be 


K (jo) = V/V, = ZL/(AZL + B) (13.29) 
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It is to be noted that K (jo) depends on the direction in which 
power is transferred in the network. If we interchange the source 
and the load, we should write the voltage-ratio transfer function for 
the reverse direction as 


Krev (0) = V/V, | Zgon the left (13.30) 


In the general case, the forward and reverse voltage-ratio transfer 
functions are not the same. 

The transfer function of a two-port. In our further discussion, the 
argument of the transfer function will be not only the variable ja, 
but also the complex frequency p. In other words, we shall use both 
K(jo) and K(p), the latter being the more general form of the 
transfer function. The transfer function of a two-port has all the 
properties of the same functions of linear stationary systems 
examined in Chap. 8. For example, the transfer function of a linear 
constant-parameter two-port has the form 


(p — z (p — z3)...(p — Zm) 
= 31 
FQ) o (5 — pM Pa) P — P9 dis 
where Kọ is a constant. If the network is stable, then the poles p,, 
Dj, -.. Pn must be located in the left half-plane, occurring as 
complex-conjugate pairs. 

Usually, an additional condition is introduced: The number of 
poles of K (p) must be greater than that of zeros, which means that at 
infinity the transfer function must have a zero rather than a pole. In 
consequence, the impulse response of the network 





h(t) = + f K (jo) exp (jot) do = » f K (pexp(ptdp 
2n _’, Jc 


must be bounded, because with an infinitely large radius of the 
integration contour C the exponential term of the integrand would 
"cancel" the integral around the arc. 

In contrast to what we have for the driving-point impedance of 
a one-port, the difference in number between the poles and zeros of 
the transfer function may be any. This is because no energy 
constraint may be imposed on the phase response. 

Location of the zeros of the transfer function. In contrast to the 
poles, the zeros of K (p) for a stable linear two-port may be located 
in both the left and right half of the complex p-plane. This is 
because the characteristic equation K(p) — 0 signifies that, given 
some V, (p) #0, the Laplace transform of the output voltage, V, (p), 
vanishes. This does not run counter to the assumption that the 
system is stable. 

Two-port networks which have no zeros in the right half-plane 
are called minimum-phase networks. If they do have zeros in the 
right half-plane, they are called nonminimum-phase networks. 


Ch. 13 A Basic Theory of Linear Circuit Synthesis 393 


The above names owe their origin to the following. Let there be 
a complex plane with points z, and z, in the left and the right half- 
plane. We also let these points be the zeros of the transfer function 
of a two-port. If the two-port is driven by a harmonic excitation 
such that p = jo, then the two points correspond to two phasors on 
the complex plane, namely: V,—jo-—z, and V,=jw—z,, 
corresponding to the respective factors in the numerator of Eq. 
(13.31). The two phasors rotate and vary in length with changes in 
the frequency o, but they do so differently. The difference is that, as 
the frequency varies from — oo to + oc, the phasor V, increases the 
phase angle of the voltage-ratio transfer function by m radians, 
whereas the phasor V, decreases the phase by the same amount. The 
voltage-ratio transfer function of a two-port is a rational function 
whose argument varies as 





AargK (o) o . — Aarg (numer.) — A arg (denomin.) 
Therefore, given the same number of zeros and poles, a non- 
minimum-phase network will show a larger change in the phase of 
the transfer function than a minimum-phase network. 

The location of zeros for K (p) is related to the topological struc- 
ture of the network. It is shown in circuit theory that any two-port 
will be a minimum-phase network if it has the property such that 
the transmission of the signal from input to output can be 
completely discontinued by breaking only one branch. Notably, any 
ladder-type two-ports are minimum-phase networks. Output 

As a rule, nonminimum-phase networks are bridge and lattice 
networks in which the signal can reach the output over two and 
more paths. The simplest example of a nonminimum-phase network 
is a balanced lattice network formed by R and C. Here, as can be 
readily seen, 


K(p) — (pRC — 1)(pRC + 1) (13.32) 


This transfer function has a zero at point p = 1/RC, that is, in the 

right half-plane. E 
However, the bridge or lattice structure does not automatically 

guarantee that the network is a minimum-phase one, so it is 

essential to verify the presence or otherwise of zeros in the right 

half-plane in each particular case. 
Relation between the magnitude and phase responses of 

a two-port. It is proved [1] that minimum-phase two-ports have 

a remarkable property: Their magnitude and phase responses are 

uniquely related to each other. The real and imaginary parts of the 

logarithm of the frequency response function 


In (| K (jo)| exp [7p x(@)]} = In| K (jo) | + jo x (o) = VK) + jo k(o) 


Input 
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form a Hilbert transform pair 
| 7 wxk(54d8 








9x(o)- — f — 

tT, -O 

1 = oxG)dé ae 
Yo = — Es v 


A minimum-phase two-port realizing a specified magnitude 
response cannot have just any phase response. Basing ourselves on 
the properties of the Hilbert transforms (see Chap. 5), we may 
argue, for example, that if the magnitude response of a minimum- 
phase two-port is a maximum at some particular frequency, its 
phase response will cross zero in the vicinity of that frequency. 

If, on the other hand, a two-port belongs to the nonminimum- 
phase class, its magnitude and phase responses are independent of 
each other. Among the nonminimum-phase networks, the most 
important role is played by all-pass two-port networks whose 
magnitude response is constant and independent of frequency. An 
example is a balanced lattice RC two-port for which (see (13.32)) 


|K(jo)) 2 1, ox = —2arctanoRC (13.34) 


Such two-ports are used for the phase compensation of signals. 
They are able to make up in part for the distortion of signals 
passing through a circuit. 

The power transfer function. As will be recalled (see Chap. 8), 
this term refers to the square of the magnitude response of 
a two-port: 


K plo) = K (jo) K* (jo) = K (jo) K ( — jo) (13.35) 


In contrast to K (jo), the power transfer function K p(w) is real. 
Because of this it is especially convenient to state the initial 
specifications needed to synthesize a two-port in its terms. Unfor- 
tunately, it does not tell us anything about the phase response of 
the system. 

As is seen from (13.35), the power transfer function is an even 
function of frequency, so it can always be represented as the ratio 
of two polynomials in powers of @?: 


K p(o) = M (@’)/N (v?) (13.36) 


By a change of variable p —jo, the power transfer function 
K p(@) is continued analytically from the imaginary jo-axis over the 
entire complex frequency plane: 


K p(p) = K(p) K(— p) (13.37) 


Equation (13.37) establishes a very important fact: If a+jb is 
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a singularity (a zero or a pole) of the function K (p), then K p(p) will 
likewise have a singularity for both p — a 4- jb and for p — — a — jb. 
It is customary to say that the singularities of the power transfer 
function show quadrant symmetry, that is, they are located in the 
complex plane so that their centre of symmetry is at the origin. 
This property is of special value for two-port synthesis, as it permits 
one to recover the frequency response function from a known 


Kp(p). 


13.4 Low-Pass Filters 


This section will be concerned with the frequency behaviour of 
low-pass filters whose function is to transmit with a minimal 
attenuation all frequencies from zero up to a desired cut-off fre- 
quency, Oc, and to attenuate all higher frequencies (from o. to 
infinity). 

Steps in filter synthesis. As a rule, the first step in the synthesis of 
frequency-selective networks is to formulate the requirements for 
their frequency response. For example in the case of a low-pass 
filter with a cut-off frequency e the ideal magnitude response has 
the form 


l, 0€ 0€ oc 


13.38 
0, 0» We (13.38) 


| K (j@)| = 
(physical frequencies, œ > 0, are meant). No constraints are imposed 
on the phase response. This approach is known as the synthesis of 
a filter from the specified magnitude response. 

It is known in advance that the ideal magnitude response defined 
in (13.38) is not physically realizable (see Chap. 8). Therefore, the 
second step of filter synthesis is to approximate the ideal 
characteristic with a funetion which may belong to a physically 
realizable network. 

The final step is to realize the selected characteristic and to 
develop a circuit diagram complete with all the necessary element 
values. 

The two forms of approximation most frequently used in 
practical filter design are the maximally flat (or Butterworth) 
approximation and the equal-ripple (or Chebyshev) approximation. 

The maximally flat approximation. This form of approximation is 
based on the use of the power transfer function 


Kp(@y) = 1/(1 + ox) (13.39) 


where ©N=0/©c is a dimensionless normalized frequency. 
Low-pass filters having such a characteristic are said to have 
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quadrant symmetry 
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The cut-off frequency 
of a filter 
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In the general case, 
the power transfer 
function may contain 
an arbitrary scale fac- 
tor 
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a maximally flat or Butterworth response, and the filters themselves 
are called maximally flat or Butterworth filters. The integer n= 1, 2, 
3, ... controls the closeness of approximation and is called the order 
of a filter. From comparison of (13.36) and (13.39) it can be seen 
that a Butterworth filter is realizable for any value of n. Within the 
pass band, that is, for O<@N<1, the square of the magnitude 
response asymptotically decreases with increasing frequency. At the 
cut-off frequency (for œn = 1) the asymptotic slope produced by the 
filter is 1010g,,0.5 x — 3 dB, irrespective of the filter’s order. The 
greater the value of n, the closer the approximation. The maximally 
flat response curves for two values of n, constructed on the basis of 
Eq. (13.39), appear in Fig. 133. 


e 
The order of a filter 


A 
Solve Problem 5 Kp 


0.5 


0.25 
Wy 
Fig. 13.3 Frequency dependence of the power transfer function of n=1 
and n=5 Butterworth filters 
The parameter n is chosen according to the degree of attenuation 


that should be given to signals at frequencies © > @¢. 


Example 13.6. Find the parameter n for a Butterworth filter with 
a cut-off frequency of 105 s^ +, whose attenuation at œ = 3 x 10° s^! 
would be at least — 26 dB relative to the level at œ — 0. 

From the statement of the problem, we conclude that the 
parameter n must be the nearest integer (with an excess) to the 
solution of the equation 


l 
10log,o 1437 = — 26 


or 
1+37"= 10? = 398 

On solving it, we get 
2n = log, 9397/log,,3 = 5.45 
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When the signal is appreciably distant from the pass band, then 
on> 1, and from Eq. (13.39) we have 


Kp(®n) x ex?" 
Hence, the asymptotic slope (attenuation) on the decibel scale is 
A-10log,,Kpz — 20n logio ON 


This implies that each time the frequency is doubled, the 
attenuation produced by a Butterworth filter is increased by 
— 20n x 0.301 x — 6n dB. That is, the magnitude response falls 
asymptotically at a rate of 6n dB/octave outside the pass band. 

The transfer function of a maximally flat (Butterworth) filter. In 
order to be able to synthesize the filter, we should change from the 
power transfer function as defined in (13.39) to the transfer function 
K (p). To this end, we introduce the normalized complex frequency 
pN = ON + JON and re-write (13.39) as 


o 13.40 
1 +(—1)"pX” EUM 


Kp(px) = K(py)K( — pn) = 


Hence it is seen that in the pw-plane the function Kp(pw) 
answering a Butterworth low-pass filter of the nth order has 2n 
poles which are the roots of the equation 


1+(—1)'p?7 =0 (13.41) 


All of these roots are located on the unit circle with centre at the 
origin. For n= 1, the coefficients of the power transfer function are 
found from the equation 


pic 

that is 

PN =l, puo —1 (13.42) 
For n=2, the equation 

pi— -1 

has four roots: 

PN, = ei"/4 PN, = en PN, = e/57 + PN, = e" (13.43) 


Finally, for a third-order (n = 3) Butterworth filter, the equation is 
PN=! 
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terval between two 
points having a basic 
frequency ratio of two 
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n=1 n=2 


Fig. 13.4 The poles of the power transfer function for a Butterworth 
low-pass filter with n=1, 2, 3 


which has six roots: 
jn/3 j2n/3 
PN, = l, pu, = €? PN, — e! í 


py, = — 1, pn, = 73, pn, = 09/3 (13.44) 


The location of the roots in the complex plane for the cases listed 
above is shown in Fig. 13.4. 

The general trend for any value of n is this: All poles are spaced 
apart the same angular distance equal to n/n; if n is an odd 
number, the first root is pj, = 1; if n is even, then pw, = exp(jr/n). 

Now we will take advantage of the fact that the poles of the 
power transfer function show quadrant symmetry, that is, their 
number and location in the two half-planes are the same. Hence, we 
may rightfully conclude that only the poles located in the left half- 
plane answer the filter being synthesized. Their “mirror images" in 
the right half-plane are associated with the function K ( — p) and are 
ignored. 

The principle described above is the pivotal one in filter 
synthesis, because the subsequent realization of the network is 
based on it. 





Example 13.7. Find the transfer function of an n — 2 Butterworth 


low-pass filter. 


The transfer function has two poles in the left half-plane (see 





Eq. (13.43): 

pu, 7 (71 +M pn, =(- 1 92 
Hence 

K(pn) = 


= (13.45) 


(PN — PNJ(N - PN) p+ V/2pn +1 


Thus, an n=2 Butterworth filter can be implemented with 
a second-order dynamic system (an oscillatory element). 
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Chebyshev approximation. Also known as the equal-ripple 
approximation, this technique is likewise widely used. For the 
resultant form of filter, the power transfer function is defined as 

1 
= 13.46 

K p(@n) 1+ £Cl(ow) ( ) e 
where e < 1 is a constant number called the ripple factor in the pass The ripple factor 
band, and C,,(@n) is the nth-order Chebyshev polynomial* defined 
by 
Cn(x) = cos(narc cos x) (13.47) 


Higher-order Chebyshev polynomials are obtained through the 
recursive (or recursion) formula 


Cn (x) = 2xC,.., (x) — Cn- 2 (x) (13.48) 


such that Co (x) 2 1 and C,(x) 2 x. 

Chebyshev polynomials are frequently used in all kinds of 
approximation problems owing to the following property: Ámong 
any polynomials of degree n with the same coefficients of the high- 
est power of the argument, these polynomials deviate least of all 
from zero in the interval — 1 «x « 1. On the other hand, Cheby- A typical plot of a 
shev polynomials sharply increase in magnitude at |x|> 1. Chebyshev polynomial 
Asymptotically, 


Cr(x) x 2" !x" for |x|> 1 (13.49) 

L| 
The property of Che- 
byshev polynomials 





Such functions are convenient to use in the ideal low-pass filter 
approximation. As is seen from (13.46), within the pass band Kp 
oscillates about unity such that the maximum value is 1 and the 
minimum is 1/(1 +7). Outside the pass band, that is, at oN > 1. 
the filter attenuates the signal appreciably. 


ETE 





Fig. 13.5 Frequency dependence of the power transfer function of a Cheby- 
shev low-pass filter 


* An alternative symbol for Chebyshev polynomials is 7,(«o) from the 
older transliteration “Tschebishev”.— Translator's note. 
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Typical plots of the power transfer functions for n=2 and n=3 
Chebyshev filters appear in Fig. 13.5. As is seen, within the pass 
band the frequency characteristics of the filters are nonmonotonic. 
The ripple in the attenuation increases with the value of &. As 
follows from (13.46), an increase in € leads to a greater attenuation 
of the signal outside the pass band. By matching two variables, 
n and e, it is possible to satisfy the initial specifications for the filter 
being synthesized. 


Example 13.8. There is an n=3 Chebyshev filter which, at the 
cutoff frequency (œn = 1), attenuates the signal in power by half, that 
is, by the same amount as a Butterworth filter. Find the attenuation 
produced by this filter at a frequency three times the cutoff frequency. 

To begin with, let us find £. As follows from (13.47), C,(1)=1 for 
any n, so Kp(1)—- 1/2 if £— 1. 

The 3rd-order Chebyshev polynomial is 


C3 (On) = 40x — 30n 


Hence, the attenuation produced by this Chebyshev filter with 
a ripple factor of unity at frequency o = 3@, will be 


Acheb = 10 log, 


1+C2(3) _ 


= — 39.91 dB 


It is interesting to note that under similar conditions an n=3 
Butterworth filter will produce an attenuation equal to 


l 
Anut = 1010810 — 


= — 28.36 dB 


Thus, a Chebyshev filter appreciably improves the performance of 
a frequency-selective system. 


The transfer function of a Chebyshev low-pass filter. As is seen 
from (13.46), the poles of the power transfer function of a Cheby- 
shev filter are the roots of the equation 


14+ 67C2(pn) =0 (13.50) 


(compare with Eq. (13.41)). 

The solution of the above equation is somewhat involved, and 
will not be given here. The interested reader is referred to [28]. 
Instead, we will simply give the results of such a derivation. First 
we introduce a design parameter 


1 1 1 1 d 
a= — sinh“ ! = m( +|/ y+ ) (13.51) 
n € n £ £^ 


The next step is to find the poles of a Butterworth filter with the 
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same value of n. Then we can change to the poles of the Chebyshev 
filter by multiplying the abscissa of each pole of the Butterworth 
filter by sinha, and the ordinate by cosh a. 

Whereas the poles of a Butterworth filter are located on the unit 
circle, those of a Chebyshev filter are located on an ellipse which, 
on the pN— on t jow plane, is specified by 


(c N/sinh a)? + (@N/cosh a)? = 1 
Once the coordinates of the poles are obtained, we can write the 
transfer function of the Chebyshev filter as 

1 
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K(pn) = 
(PN — PNi)(PN— PN2)..(PN — PN») 
Example 13.9. Find the transfer function of an n=2 Chebyshev 
filter with g 5 1. 
Here 
A 


1 - 
Work Problem 9 i Ea 2) = 0.4407 


The corresponding Butterworth filter has two poles: 
PN, =0.707( — 1 +j) and pn, =0.707(— 1 — j) 
Hence, the abscissae of the Chebyshev filter are — 0.707 sinh a= 


= — 0.322, and the ordinates are +0.707 cosh a= +0.777. 
It is seen from the above example that in going from a maximally 


flat to a Chebyshev response, the poles move towards the imaginary 
axis, whereas their vertical displacement is insignificant. Physically 
this signifies that the oscillatory system making up the Chebyshev 


filter will produce a smaller attenuation. 


13.5 Implementation of Filters 


The final step in the synthesis of a filter is to find its circuit 
arrangement. In this section we will consider what is known as 
structural synthesis in which a circuit is formed by a cascade 
connection of a number of sections or stages separated from one 
another by ideal isolation networks (Fig. 13.6). The voltage-ratio 
transfer (frequency response) function of such a device is given by 


K (jo) = K, (jo) K- (jo)... KN(ja) 
The individual functions K,, K,, ..., KN must be such that they 


realize the poles of the transfer function K (p), defined earlier during 
the approximation step. 


e 
Structural synthesis 
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The use of isolation 
networks is widely 
practised in present- 
day | microelectronic 
active circuit synthesis 
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Isolation networks 


Fig. 13.6 Filter formed by a cascaded connection of elements (the isolation 
networks are usually emitter followers) 


It takes two kinds of networks to build a low-pass filter, namely 
a st-order network which has only one real pole, and 
a second-order network which has a pair of complex conjugate 
poles. 

The 1st-order network. The simplest example of this kind is an 
L-section RC two-port for which 


K(p) — 1/(1 + pRC) (13.52) 


the coordinate of the pole being p, = — 1/RC. 

It is to be noted that by specifying p,, we only obtain the 
product RC. One of these two elements, R or C, may be chosen at 
will. For example, it may be desired that the capacitance C be 
substantially greater than the input capacitance of the succeeding 
stage. This will make the filter less sensitive towards inaccuracies in 
the selection of the element values. 

The 2nd-order network. Two complex conjugate poles of the fre- 
quency response function can be realized with the aid of the 
L-section two-port shown schematically in Fig. 13.7. 





Fig. 13.7 A 2nd-order element: (a) schematic diagram; (b) location of the 
poles of the transfer function 


It is an easy matter to find that for this type 


2 
2 


K (p) - ———9 


—o—— x 13.53 
p? + 2ap + o ( ) 


where 
© = 1///LC and a= 12RC 
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The poles of the transfer function are 





Pi2= - ijj ap — a? (13.54) 


which may be complex conjugate or real, depending on the relative 
magnitude of oy and «a. 

Let us consider several examples of a low-pass filter implemented 
with cascade-connected networks. 





z 
f 
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Example 13.10. Realize an n — 3 Butterworth filter with a cut-off 
frequency of 105 s^ !. The filter is loaded into a resistor Ry — 
=0.5 KQ. 

As has been shown, the transfer function of such a filter has three 
poles located as follows: 


P1,2 = 10? (cos 60° + j sin 60°) 
= — 0.5 x 10° + j0.866 x 10° s`! 
Pac — 10? S 1 


Here, we have changed from the normalized co:aplex variable pw to 
the true complex frequency p = ogpw. 

Accordingly, the sought-for filter may be visualized as a cascade 
connection of a Ist-order stage corresponding to the pole p}, an 
isolation network, and a 2nd-order stage for which the poles are p, 


and p;: 
Ist- order 2nd- order 
network network 


In accordance with (13.52), the ist-order stage must have a time 
constant RC — 1/oc:— 10 ? s. If we choose C — 10 nF, then the 
resistor used in this stage will be R — 10 5/C — 1 KQ. 

.Let the resistor used in the 2nd-order stage be the load resistor. 
On the basis of (13.54), the pair of complex conjugate roots will 
have the desired real part if 


1/2RLC = — Re p, 2 = 0.5 x 10? 





Hence, 
C =1/10°R, = 0.02 pF 


Finally, the inductance is 
L= 1/@2C =5 mH 


The schematic diagram of the synthesized filter has the form 
1kQ 5mH 







Isolation 
network 


Input 


10 nF 
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Example 13.11. Realize an n=2 Chebyshev low-pass filter 
operating into a resistive load, Ry, = 1 KQ. The initial specifications 
for the synthesis are: cut-off frequency, @c = 105 s ^! ; ripple factor, x 
gu. 
In order to realize the second-order frequency response, it will Solve Problem 12 
suffice to have one L-section RLC-network. In Example 13.9 we 
have obtained the coordinates of the poles of the transfer function 
for an n— 2 Chebyshev filter with = 1: 


PNi.2 = — 0.322 + j 0.777 
or, on changing back to the non-normalized variable p, 
P12 =( — 0.322 + j 0.777) x 10° s~? 


The capacitance of the capacitor C can be found from (13.54) on 
equating a to the required abscissa of the poles: 


a = 1/2RLC = 0.322 x 10° 
Hence, 
C = 15.53 nF 

The inductance L is found from the equation for the coordinates 
of the poles on the imaginary axis: 
V eà — a? =0.777 x 10° 
On solving it, we get A 

Solve Problem 13 

Q3 = 1/LC = 0.708 x 107° 


L= 1/o2C = 9.09 mH 


Thus, the specified response characteristic is realized by the 


following circuit 
Son 
1kQ 
15,53 nF 


It is to be noted that in practice, especially at microwave fre- 
quencies, use is made of filters in which there are no isolation 
networks. The reader may acquaint himself with the techniques 
used for the synthesis of such circuits in [29]. 

Implementation of high-pass filters. The function of a high-pass 
filter is to pass waves whose frequencies exceed the cut-off fre- 
quency, ©e, with as little attenuation as practicable. 

A high-pass filter can be generated directly from a normalized 
low-pass filter having the same cut-off frequency through a techni- 





Input 
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que known in circuit theory as frequency transformation. The gist of 
the technique is as follows. 

To begin with, we change from the variable p used in the 
synthesis of low-pass filters to a new frequency variable p' such that 
pop (13.55) 
Then the point p — 0 will map into a point at infinity in the 
p-plane, and the two points p, ; = t joc on the imaginary axis will 
map into two points p,,= + j@c, the latter differing from the 
former only in sign. Therefore, we may expect that the magnitude 
response of the high-pass filter generated from a low-pass filter by 
frequency transformation defined in (13.55) will be that of a high- 
pass filter. 

Now each capacitor which has admittance pC in the low-pass 
filter must be replaced with an element whose admittance is o ?C/p', 
that is, with an inductor of inductance L= 1/oC. Similarly, the 
inductor Lin the low-pass filter must be replaced with a capacitor. 
C-l/oiL. The resistive elements are left unchanged. The 
transformation just described is illustrated in Fig. 13.8. 






1/(9? L,)l, 1/(9212) 
jud» 1/(w2C) 





Fig. 13.8 Transformation of a low-pass filter into a high-pass filter 


Implementation of band-pass filters. A band-pass filter passes 
with a small attenuation only the frequencies in the interval 
adjacent to some point ®g+ 0. If there is a normalized low-pass 
filter with the specified cut-off frequency, we can go over to 
a band-pass filter directly by a change of the variable 


p=p' + @/p' 
Now the point p —0 will map into a point p'—jo,, so that the 
peak of the magnitude response observed at zero frequency in the 
low-pass filter will occur at frequency o, in the band-pass filter. 
Since 


(13.56) 


oC 


/ 





pC — pC- 


the admittance of the capacitor used in the low-pass filter must be 
replaced in the band-pass filter with the admittance of a parallel 
resonant circuit made up of a capacitor C and an inductor of 
inductance L= 1/@@C. It is to be noted that this resonant circuit is 
tuned to frequency Og. 


405 


Frequency transforma- 
tion ought not to be 
confused with the fre- 
quency conversion ef- 
fected by nonlinear and 
parametric networks 


Frequency transforma- 
tion entails some dis- 
tortion in the ampli- 
tude response of the 
filter being synthesiz- 
ed, but it is of mi- 
nor importance for a 
narrowband filter 
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Similarly from the equality 
pL= p'L+ w3L/p’ 


we conclude that the inductor Lis to be changed into a series 
combination of the same inductor and a capacitor C — 1/a@pL, 
which is recognized as a series resonant circuit tuned to frequency 
Og (Fig. 13.9). 


W(wel,) — 1/(w Ly) 


L | L 
2 


ati | 





V(we C) 





Fig. 13.9 Transformation from a low-pass filter into a band-pass filter 


From the examples examined above it follows that in the 
synthesis of frequency-selective networks the low-pass filter serves 


The prototype filter as the prototype filter whose parameters make it possible to 


generate subsequently any other form of filter. 


Summary 


$$ 3333 $8 $8 g 


The poles and zeros of the driving-point (input) impedance of a stable linear one-port 
are located in the left half of the complex-frequency plane and form complex- 
conjugate pairs. 

The number of poles of the driving-point impedance of a passive one-port differs from 
the number of zeros by not more than one. 

The real and imaginary parts of the driving-point impedance of a one-port are related 
by a Hilbert transform pair, if the given one-port belongs to the class of 
minimum-impedance networks. 

The driving-point impedance of a reactive one-port is a non-decreasing function of fre- 
quency (Foster’s theorem). 

The synthesis of a one-port from the specified driving-point impedance is effected 
within the framework of the specified circuit structure. This can be done by the Foster 
(or partial fraction expansion) method or by the Cauer (continued-fraction) method. 
The poles of the transfer function of a stable two-port (four-terminal) network are 
located only in the left half-plane. 

The zeros of the transfer function of a stable two-port may be located in the right 
half-plane (nonminimum-phase networks). 

The poles and zeros of the power transfer function show quadrant symmetry. 
The poles of the transfer function of a maximally-flat (Butterworth) low-pass filter are 
located on the unit circle whose radius is equal to the cut-off frequency. 
The poles of the transfer function of an equal-ripple (Chebyshev) filter are located on 
an ellipse whose eccentricity is given by the ripple factor of the magnitude response. 
High-pass and band-pass filters can be generated from a known low-pass filter which 
plays the role of a prototype. 
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Review Questions 


4U/ 


1. Write the characteristic equations for a one-port which is (a) open-circuited and (b) 


short-circuited. 


2. Define the property of a positive real (p.r.) function. 

3. What one-ports are called minimum-impedance networks? 

4. Name the basic properties of the poles and zeros of reactive one-ports. 

5. Give an example of a ladder network and show how its driving-point immitance 
(impedance or admittance) can be written in the form of a continued fraction expansion. 


. What one-ports are called canonical? 


. Name the network functions used to characterize two-ports. 


. Why is it that any ladder two-port is a minimum-phase network? 


two-port? 


6 
7 
8. Why is it that the transfer function of a stable two-port must have a zero at infinity? 
9 
0 


. What is the relation between the magnitude and phase responses of a minimum-phase 


11. Name the engineering applications of nonminimum-phase networks. 
12. How are the poles of the transfer function of a Butterworth low-pass filter located? 
13. Explain. why Chebyshev polynomials are convenient for use in the low-pass filter 


approximation. 


14. What is the difference between the properties of Chebyshev and Butterworth filters? 
15. What is the principle of the structural synthesis of filters? 
16. Write the equations involved in the frequency transformation of low-pass to high-pass and 


band-pass filters. 


Problems 


I. Verify Eq. (13.16) with reference to the 
parallel RC-network examined in Example 
13.1. 

2. Show that the function 


(p + 0 + 5) 

pip^ + 3)(p? +7) 
is the driving-point (input) impedance of 
a realizable purely reactive one-port. 

3. Implement the Foster-form network 
whose driving-point impedance is 
pl p? +4) 

p 1 

4. Implement two Cauer-form networks 
whose  driving-point impedances are 


specified in Problem 3. 
5. Prove that the first n — 1 derivatives of 





Z(p) 


Z(p)= 


the power transfer function of an nth-order 
Butterworth filter vanish at ow = 0. 

6. A Butterworth filter has a cut-off fre- 
quency of 10 kHz. In changing from 80 kHz 
to 160 kHz, the harmonic attenuation is 
increased by — 36 dB. Find the order of the 
filter. 

7. Find the transfer 
a 4th-order Butterworth filter. 

8. A Chebyshev filter has a ripple factor 
£ = 0.3. What is the ripple factor of the same 
filter at ON < 1 in decibels? 

9. Find the transfer function of an n=2 
Chebyshev filter for € = 0.5. 

10. Show that a change in the resistance 
of the resistor R in a 2nd-order network 
causes the complex-conjugate poles of the 
transfer function to move round a circle of 


function of 
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radius og. Analyse also the case of & > wọ. 

11. Implement a 2nd-order Butterworth 
filter with a cut-off frequency @,=10°s'. 
The filter is loaded into a resistor RL= 
=20 kQ. When specifying the element 
values, make sure that the network is 
physically realizable. 

12. Locate the poles of the transfer 
function of an n2 3 Chebyshev low-pass 
filter for which o, —4x10*s^! and £= 
-— 0.5. 

13. Implement the filter examined in 
Problem 12 by connecting in cascade 
a ist-order and a 2nd-order network. The 
load resistance of the filter is Rp =2 kQ. 


Advanced Problems 


14. The real part of the driving-point 
impedance is 





100 
1 107 12m? + 10 7 ?*9* 
Find the expression for the complex 


driving-point impedance and draw up the 
corresponding circuit diagram. 


15. Investigate the driving-point impe- 
dance Z (p) of a semi-infinite ladder network 
with a periodic structure of elements. 

16. There is a system which performs an 
ideal delay of signals for T' seconds. Its 
transfer function is 


1 
1+ pT- (pTY./21 +... 


Check to see if this characteristic can 
approximately be replaced with a rational 
function whose denominator has various 
orders. Find the poles of the transfer 
function to a first, second, and third 
approximation. 

17. Investigate the phase response of 
a Butterworth low-pass filter. Derive the 
equation for the group delay time for œ = 0 
and o6 = x. 

18. Calculate the impulse responses for 
2nd-order Butterworth and Chebyshev 
filters. 

19. Derive an equation defining the 
asymptotic slope in decibels for the response 
of a Chebyshev filter at frequencies 
substantially exceeding the cut-off frequency. 








K(p) = exp( — pT) 


e 
The forward-path and 
the feedback elements 


Chapter 14 


Active Networks with Feedback. 
Self-Excited Oscillatory Systems 


This Chapter will be concerned with a special class of active 
linear and nonlinear circuits in which all or a part of the output 
signal is fed back to the input. Quite aptly, they are called circuits 
or networks with feedback. 

The application of feedback makes it possible in some cases to 
improve the performance of the circuit involved to a marked 
degree. In other cases, given certain conditions, feedback may 
render the circuit unstable so that it jumps into self-excited 
oscillations. This principle underlies the operation of various 
self-excited oscillatory systems, above all harmonic oscillators which 
are integral parts of transmitters. 


14.1 The Transfer Function 
of a Linear Feedback System 


In order to make the results of the analysis that follows 
applicable to a wide range of various special cases, we will consider 
the problem of a feedback circuit in the most general terms, 
without exactly specifying the physical character of the input signal 
(excitation) and the output signal (response). 

The derivation of the basic relation. We will be concerned with 
the* linear system shown in block-diagram form in Fig. 14.1. 

Referring to the diagram, the system is seen to consist of two 
four-terminal networks. The active two-port whose transfer function 
is K(p) is the forward-path element of the system. The other 
two-port, usually a passive one, is called the feedback element with 
a transfer function (the feedback ratio) B(p). The arrowheads in the 
figure indicate the direction of signal flow around the system. 





Input Output 


Fig. 14.1 Block diagram of a linear feedback system 


At its input, the forward-path element has a network which 
combines the input signal and the output signal from the feedback 
element. If V (p) and Vou(p) are the Laplace transforms of the 
input and output signals, respectively, it is easy to see that 


Vout(p) = K (p) [Vin (p) + B (p) Vout (p)] (14.1) 
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Sometimes, instead of 
the terms “positive” 
and “negative” feed- 
back, the wider con- 
cept of “complex” 
feedback is used. In 
this case, the value of 
the phase shift in the 
feedback element is 
specified 
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Hence we can directly derive the equation defining the transfer 
function of a system with feedback: 


K (p) 


e 14. 
1- PPKO une) 


Kp (p) = Vout (p)/Vin (Pp) = 


In accordance with the above equation, the frequency behaviour of 
the system depends equally on the transfer function K(p) and the 
feedback ratio B(p). Therefore, it is possible, while leaving the 
forward-path element unchanged, to vary the frequency 
characteristics of the entire system over a wide range by varying the 
parameters of only the feedback element. 

Negative and positive feedback. Examine Eq. (14.2) for p= jo. 
The frequency response of a system with feedback* is 


K (jo) 


1807 T= Bw) K Go) P 
If at a specified frequency o, 
11 — BGo) K o)| > 1 (14.4) 





then feedback will reduce the magnitude response of the system 
and, as a consequence, the amplitude of the output signal. This is 
known as negative (degenerative) feedback. If the converse is true, 
that is 


11 — B(jo) K (jo)| « 1 (14.5) 


we have positive (regenerative) feedback. 

Both forms of feedback are widely used in communication 
applications. It should be borne in mind, however, that positive 
feedback may cause instability in the system. To demonstrate, let, 
for example, B = By and K = K, be positive real numbers. If f, is 
equal to zero initially and increases afterwards, then in accordance 
with Eq. (14.3) this brings about an increase in the overall gain or 
closed-loop gain Km. Should Bo become equal to 1/K,, then Kø = 
= oo, and this implies the self-excitation of the system, or the 
appearance of an output signal when there is no signal at the input. 

Negative feedback makes it possible to improve considerably the 
frequency response of amplifiers. The examples that follow will 





* [n engineering applications, this quantity is usually referred to as the 
closed-loop gain or the overall gain with feedback.- Translator's note. 
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demonstrate some of the specific applications where negative 
feedback is warranted. 

Gain stabilization. Suppose we have an amplifier with a large, 
but insufficiently stable gain Ky. It is required to build on its basis 
an amplifier with an improved gain stability. By applying a negative 
feedback loop to the amplifier, that is, by taking B(ja)= — Bo <0, 
we obtain on the basis of (14.3) 


Kp = Ko/(1 + Bo Ko) 
Hence, 
dKrm/Km = [1/(1 + BoKo)] (GKo/Ko) (14.6) 


If B) Ky > 1, the relative instability in the resultant gain decreases 
by a factor of about B5 K,. True, the gain itself decreases by the 
same factor, but this does not usually pose any problem because 
the desired gain can always be secured by adding more stages to 
the amplifier. 

Suppression of parasitic signals. Let the forward-path element of 
an amplifier be a cascade connection of two networks of gains K, 
and K,, respectively. At their junction, an unwanted parasitic signal 
Vpar is injected. A negative feedback loop with the fraction fed back 
B is applied to the amplifier as a whole. It is required to determine 
the parasitic-signal gain Kpar= Vout/Vpar, that, is the extent to 
which the parasitic signal is allowed to reach output. 

Since obviously 


Vout = K, (Vpar = BK, Vout) 
then 
Kpar = Vout/Vpar = K2/(i + BK, K;) (14.7) 


It is seen that the parasitic signal breaking through into the 
system at a point close to its output, that is, with K, « K,, will be 


. 


substantially suppressed. This effect provides the basis for the. 


control of nonlinear distortion in multistage amplifiers (Fig. 14.2). 


Harmonics 





Fig. 14.2 Harmonic suppression in a multistage negative-feedback amplifier 
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In high-fidelity (hi-fi) 
amplifiers the non- 
linear distortion is a 
fraction of one per cent 


Here, negative feed- 
back exists, owing to 
the sign of the gain 
at the zero frequency 
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As will be recalled (see Chap. 11), nonlinear distortion manifests 
itself as the appearance of signal harmonics because of the 
nonlinearity of the active elements. The harmonic content goes up 
as the signal amplitude is increased. Mentally, it may be pictured as 
if the unwanted harmonics are injected into the system from 
without, mainly in the final power stages of the amplifier. On the 
basis of (14.7) we conclude that negative feedback can substantially 
reduce the harmonic content at the output. Therefore, practically all 
amplifiers intended for the high-fidelity reproduction 
of audio signals (in radio broadcasting, sound recording) use negative 
feedback. 

Frequency response compensation. 


Consider a_ single-stage 


RC-loaded transistor amplifier whose transfer function (see 
Eq. (8.43)) is 
K(p)= — Ko/(l + pteq) (14.8) 


where Ky = gmReg, and Teg = Reqs. 
At zero frequency, the gain factor is negative 


K(0)= -Ko 


By applying to this amplifier a frequency-independent feedback 
loop with a positive real parameter B (jo) = Bo, we will, on the basis 
of (14.2), have 


Kip (0) = = Ko/(1 + BoKo) 


Since 1 + BoKo > 1, we have negative feedback. It is easy to verify 
that the feedback will remain negative at all frequencies because 


BoKo | 
1 — BgK (jw) | = | 1 4 ———— 
|1 — BoK (jo) | | m 
at any frequency >0. On substituting (14.8) in the general 
equation (14.2), we obtain the following expression for the transfer 
function of a negative-feedback amplifier: 








Km(p)- E (14.9) 
(1 + BoKo)  Pteq 

Hence follows an expression for the magnitude response 

| Kro(jo)| = Ko (14.10) 


ya - BoKo)? + o tiq 


Figure 14.3 shows a set of amplitude response curves for 
amplifiers differing in the negative feedback level as defined by the 
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WTeq 





Fig. 14.3 Amplitude response of a single-stage RC-loaded amplifier for 
various levels of negative feedback 


parameter* 
d= BoKo (14.11) 


The figure brings out the principal effect of negative feedback: the 
amplitude response of the amplifier is “equalized”, or compensated, 
owing to a reduction in gain at lower frequencies. As 
a consequence, the effective bandwidth of the amplifier is extended. 
Thus, on the basis of (14.10) the upper limiting, or cut-off, frequency 
@c, defined as one at which the gain of the amplifier falls to 0.707 
times the maximum gain, Ko, is 


We = (1 + BoKo)/teq (14.12) 


and increases linearly with increasing negative-feedback factor. 

The simplest way to apply negative feedback to a single-stage 
common-emitter amplifier is to place an additional feedback 
resistor Ræ in the emitter lead. The resultant increase in the input 
resistance brings about an increase in the emitter current and, in 
consequence, an increase in Vg, the voltage across the feedback 
resistor. Therefore, the control voltage of the transistor becomes 


VBE = Vin — Vio 
which is another way of saying that negative feedback does exist in 
the amplifier. 
Positive feedback in a tuned amplifier. Consider a single-stage 
small-signal tuned amplifier whose frequency response is 
Ex Kres 


K(jo)= 14.13 
uo 14+ jtckr(@ — Ores) i } 





where Kres= g mR res, and Tekt = 20 /0,4, is the time constant of the 
resonant (tuned) circuit. 


* In books on practical radio engineering, it is often called the feedback 
factor, or return ratio, or loop gain—Translator’s note. 
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Only positive frequen- 
cies are considered 
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Now suppose that to this amplifier we apply a frequency- 
independent positive feedback loop with the parameter B, such that 





i K (jo) — Kres/(1 — Bo Kres) 
K = = 14.14 
BUD TF BK Ga) | War cH em 
1 T Po Kres d 


From comparison of (14.13) and (14.14), it is seen that for 
Bo K res < 1, the positive-feedback amplifier has a frequency response 
of the same form as the amplifier without feedback. However, in the 
case of positive feedback there is an increase in the gain at 
resonance by a factor 1/(1 — ByKres); the equivalent Q-factor of the 
resonant circuit of the amplifier is increased in the same proportion 
Qeq b= Qeq/(1 = BoK res) 
whereas the bandwidth of the amplifier is reduced by the same 
factor. 

These changes are explained by the fact that positive feedback 
produces regeneration—a partial compensation of the losses suffered 
by the resonant circuit. The energy required for the regeneration is 
drawn from the power supply. 

Positive feedback in a tuned amplifier can be produced by 
placing an inductor connected in series with the input circuit and 
inductively coupled with the resonant circuit. 

Despite a number of obvious advantages, positive-feedback 
amplifiers are used only seldom because they tend to jump into 
self-excited oscillation as the feedback factor BoọKres goes to unity. 

Delayed feedback. Figure 14.4 shows a block diagram of a system 
in which the feedback path contains a scaling amplifier with 
a constant fraction fed back, By, and a pure delay element which 
delays signals for a time Tp. 

Let the gain Ko of the forward-path element be frequency 
independent. Then 


Ko 


_——2 _ (14.15) 
1 — BoKoexp( —j oto) 


Kp 0) = 





T Output 


Input 


Fig. 14.4 Block diagram of a delayed-feedback system 
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The amplitude response of the system is 
Ko 

V1 — Bo Ko cos ox, + (Bo Ko)? 

If BoKo <1, the system is stable. Its amplitude response is 

represented by a periodic curve with alternating maxima and 

minima which implies that the character of feedback is different 

(positive or negative) at different frequencies. 

Delayed feedback makes it possible to build frequency-selective 
systems with a periodic amplitude response, known as comb filters 
so named because their response characteristics have the 
appearance of a comb. 

It is to be noted that this type of systems are capable of jumping 
into self-excited oscillation as B5 K, 1. 








| Km 9| = (14.16) 


14.2 Stability of Feedback Networks 


This section will discuss the stability of feedback systems. The 
objective of the discussion is to confirm the qualitative reasoning 
pursued earlier with regard to self-excitation of positive feedback 
systems. 

The statement of the problem. Consider a system made up of an 
active forward-path element whose transfer function is K(p) and 
a feedback element whose transfer function is B(p). The output of 
the forward-path element is returned to the system's input via the 
feedback element. It is assumed that no external input signal is 
applied, so that the system is self-contained. 

The equation of state is wrftten on the basis of the fact that 


Vout(p) = K (p) P (p) Vout(p) 
Hence, 
[1 — BPK (p)] Vout(p) = 0 (14.17) 


Since Vout(p) 40 identically (otherwise the system would not be 
excited), then the equality (14.17) will be satisfied only for those 
values of p which are the roots of the characteristic equation 


1 — B(p)K(p) =0 (14.18) 
Let pi, P2, ... be the roots of the characteristic equation. Since the 
system is linear, the output signal will in the general case have the 
form 

Vout(t) = A, exp(p,t) + A;exp(pst) 4 ... (14.19) 


For the signal to be bounded, it is necessary that all the roots of 
the characteristic equation have negative real parts, that is, be 
located in the left half p-plane. A feedback system possessing such 
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properties will be absolutely stable in the sense defined in Chap. 8. 

Two problems may arise in the study of feedback systems. If the 
system being synthesized, say an amplifier, must be stable, we need 
a criterion with which we could immediately tell from the form of 
the functions B(p) and K (p) that the characteristic equation has no 
roots lying in the right half p-plane. Conversely, if feedback is 
utilized to build an unstable self-excited oscillatory system, we need 
to know the roots of Eq. (14.18) defining the frequency at which the 
system will jump into self-oscillation. 

This section will be concerned with the first of the two problems. 
It is to be noted that the conclusions derived here apply not only to 
the stability of feedback systems, but to the stability of any linear 
dynamic system as well. 

Algebraic criteria of stability. Suppose that both the forward-path 
and the feedback elements are lumped-parameter networks and so 


K (p) = P, (p)/Q, (p) 
B (p) = P2(p)/Q2(p) (14.20) 


are the ratios of the polynomials in powers of p. On substituting 
(14.20) into (14.18), we obtain the characteristic equation of the 
system 


= P 
000P) -P PO) _ T 
Q: (p)Q2 (p) 
Hence it follows that a feedback system is stable if all roots of the 
equation 
H (p)= Q, (p) Q5 (p) — P, (p)P (p) = 0 
have negative real parts. In algebra, polynomials H (p) with such 


properties are called Hurwitz polynomials. 
Consider a special case of the Hurwitz polynomial 


H (p) = (p — p,)(p — p2)(P — Ps) 


which has three roots one of which, p, = — o, is real negative, 
whereas the remaining two, p,,;= —p-jog, are complex 
conjugate numbers with a negative real part. On direct substitution 
of the roots, we find that the polynomial 





H (p) - (p + o) [(p + B + ox] 
= p? + (a + 28) p? + (B? + 2a + xo) p + a (B? + exo) 


contains all powers of the variable p, beginning with the highest 
one, and all of its coefficients have the same sign. These attributes 
only indicate the necessary conditions for a polynomial to be 
a Hurwitz polynomial. The complete solution of the problem was 
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obtained at the end of the last century and has been embodied in 
what is known as the Routh-Hurwitz criterion. The proof of the 
criterion can be found in [11]. We will only give the final result: 
For the equation 


dnp a, p *+...+a;pta,=0 


with real coefficients to have roots lying in the left half p-plane, it is 
necessary and sufficient that the following quantities be positive: 
(1) The coefficients an, dg. 
(2 The Routh-Hurwitz determinant 


Gn—~1 n 0 0 0 0 
Gn-3 Ün-2 CÜmn-i Gn 0 0 
Di = Üg-5 Gn-4 4n-3 Qn-2 0 0 
0 0 0 — eu Ay a, 


and all of its principal minors. 
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Example 14.1. Using the Routh-Hurwitz criterion, test the stability 
of a system whose characteristic equation has the form 


p> + 2p? + 6p+4=0 


We satisfy ourselves that a4, ag 0. Next, we form the 








determinant 
2 1 
D, = =8>0 
A dis 
Solve Problem 6 The only principal minor is 2» 0. Hence the system is stable. 


An advantage of the Routh-Hurwitz criterion is the relative 
simplicity of calculations. A disadvantage is that its applicability is 
limited to lumped-constant networks because it is only for them 
that the transfer function is expressed in terms of polynomials. 

Graphical criteria of stability. Going back to the characteristic 
equation (14.18) we note that the product 


w(p) = B(p) K (p) (14.22) 


is nothing but the transfer function of a cascaded connection of 
a forward-path element and a feedback element. Usually, w(p) is 
called the open-loop transfer function of a feedback system. 

The function in (14.22) may be looked upon as a mapping of the 
complex p-plane onto another complex w-plane. If p,, Pa, ... are the 
roots of the characteristic equation 


1 — B(p K(p) «0 
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then, as can be readily seen, all of these points will be mapped in 


the w-plane into an only point, w=1. 


Hence we can directly formulate the rule for determining whether 
a feedback system is capable of self-excitation: If, under the 
conformal mapping of (14.22), the w-plane image of the right half 
p-plane contains the point w = 1, the feedback system is closed-loop 


unstable. 


The imaginary (jo) axis in the p-plane maps into a curve in the 
w-plane. The equation of the curve in parametric form is 


w (ja) = B (o) K (jo) 


The parameter is frequency œ which varies between the limits — oo 
e and + œ. The curve is called the Nyquist locus of an open-loop 


The Nyquist locus 


feedback system. In all cases of practical interest, the amplitude 


response tends to zero with increasing frequency, so the Nyquist 
locus passes through the point w — 0. Also, the Nyquist locus is 
symmetrical about the real axis in the w-plane, because w( — jo) — 
= w* (ja). Obviously, the Nyquist loci for the systems in question 


are closed curves in the w-plane. 


e In the theory of functions of a complex variable it is shown [11] 
The Nyquist stability that under the conformal mapping of (14.22) the image of the right 
criterion half-plane is the area enclosed by the Nyquist locus. The stability 


criterion arising from the above procedure is known as the Nyquist 
stability criterion: If the Nyquist locus of an open-loop system 
encloses the point (0, 1), the system is closed-loop unstable. 


Example 14.2. Investigate for stability a single-stage RC-coupled 
amplifier whose output is directly connected to its input. 
Here, obviously, B(p)= 1, and 


K(p)= — Ko/(n + pt) 


where 
Ko =9mReq and t= RegC, (see Chap. 8) 
The equation of the Nyquist locus takes the form 


w (ja) = E eee [j (x — arc tan ox)] (14.24) 
V1 oc 

The Nyquist locus plotted on the basis of Eq. (14.24) appears in 
Fig. 14.5. As is seen, the locus diagram is a circle of diameter Ko. 
The top semi-circle is the image of the positive part of the jw-axis. 
As the frequency rises, the amplitude response decreases, and the 
phase angle tends to 90°. 

Since the Nyquist locus is entirely in the left half-plane and does 
not enclose the w— 1 point, the connection of the output of the 
amplifier to its input leaves the system stable. 
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Fig. 14.5 Nyquist locus diagram of a single-stage RC-loaded amplifier. (The 
numerals in circles indicate corresponding points on the jo-axis and on the 
Nyquist locus.) 


Example 14.3. Using the Nyquist stability criterion, investigate for 


stability a two-stage aperiodically loaded amplifier whose transfer 
function is 


K(p) = K, (p K: (p) = Ky, Koo (1 + pt) (14.25) 


To simplify the matters, it is assumed that the two stages have the 
same time constant; the gain constants at zero frequency, K,, and 
Ko2, may in the general case be different. 

By a change of variable p — jo in (14.25), we obtain the equation 
for the Nyquist locus 





Ko, K 
w (jo) = Ky,Ko2/(1 + jot)? = i ra exp( —j2arctanox) (14.26) 


The Nyquist locus diagram for the amplifier in question appears 
in Fig. 14.6. 





Fig. 14.6 The Nyquist plot of a two-stage, aperiodically loaded amplifier 


420 


Part Two. Circuits 


If the overall open-loop gain at zero frequency Ko = Ko, Ko. is 
greater than unity, then, on closing the feedback loop, the system 
turns unstable, because the w= 1 point is now enclosed within the 


Nyquist locus. 
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The opamp 








Apart from the Nyquist criterion, stability analysis uses a number 
of other geometric procedures applicable to linear feedback systems, 
such as the root-locus method and the Bode method [37]. They are 
widely employed in control system analysis. 


14.3 Active RC Filters 


Present-day advances in radio engineering and electronics, 
notably the advent of microelectronic components, have brought 
about sweeping changes in the previously widely used circuit 
designs. The changes have also affected the theory and practice of 
frequency-selective filter synthesis. 

Among other things, it has been found that no microminiature 
counterpart of the inductor can be fabricated. Yet, to implement 
conventional 2nd-order oscillatory (RLC) networks, one needs 
inductances (see Chap. 13). The way out has been found with the 
development of so-called active RC filters. An active RC filter is 
a combination of a passive RC-network and an active element, the 
latter usually being a complex transistor circuit which transfers 
some of the power it draws from a power supply to the passive 
network. 

In this section we will be concerned with one of the principles 
used to build active RC filters which include an operational 
amplifier used as the active element. 

The operational amplifier. This term refers to an amplifier with 
a large gain Ky over a broad interval of frequencies, beginning at 
zero frequency. An operational amplifier has a high input 
impedance (in practice, tens or even hundreds of kilohms) and 
a fairly low output impedance (tens of ohms) Therefore, an 
operational amplifier may approximately be treated as 
a voltage-controlled voltage source. This model of a controlled 
active element is often used in circuit theory. Present-day 
operational amplifiers (or opamps, as they are frequently termed for 
short) have a gain of around 10* or 10°. As a rule, an integrated- 
circuit (IC) opamp has an inverting (“—”) input and a non-inverting 
(“+”) input. If vin; and v; are the input signal voltages at the 
non-inverting and inverting inputs, respectively, the output voltage 
is 


Uout — Ko (vin: = Vin2) (14.27) 


Opamps are among the most widely used analog IC’s. 
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Stability of a system with an opamp. If feedback is applied 
around a system incorporating an opamp, a condition of instability 
is very likely to develop. As an example, consider a system in which 
the output of the opamp is connected to the non-inverting input via 
a resistor R. Let C, be the stray capacitance at the input of the 
opamp. Since the input impedance of the opamp is infinitely high, 
the Laplace transform of the input voltage, V,(p) is related to the 
Laplace transform of the output voltage, V,(p), in a simple way 


1/pC, 
ex 
1/pC,+R 
On the other hand, 
V, = V,/Ko 


The two equalities can be satisfied at the same time only if p is the 
root of the characteristic equation 


11 + pRC,)=1/K, 
that is, 
p= (Ko — 1)/RC, 
Thus, at K, > 1, the system is unstable; the voltages around the 
system build up in time as exp[(Ky — 1)t/RCs]. 

It is clear that a system in which the output of the opamp is 
connected to the inverting input via a resistor is stable. 

The principle of synthesis of active RC networks. Let us examine 
in a very general way one of the procedures for the synthesis of an 


active filter on the basis of an opamp (Fig. 14.7). This procedure is 
applicable to a large number of practical circuit designs. 





Fig. 14.7 Active RC-network built around an opamp 


The passive part of the device is a three-port made up of 
elements R and C. Terminal / is the input; the opamp is connected 
between terminals 2 and 3, so that use is made of the inverting 
input. 

This circuit is a special case of the feedback system examined at 
the beginning of this chapter. In order to find the transfer function 
of the system in question, we will describe the passive three-port 
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The signal at the 
inverting input is zero 
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Note that the inverting 
input of the opamp is 
used 
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with the aid of its Y-matrix: 
I, = Y, Vy; + Yi; V; + Yia V3 
L= Ya Vi + Yz;V; + Yi V, (14.28) 
I, = Y4 V, + Yj;V; + Y V, 
If Kg is the gain of the opamp, then 
V3= — Kol, 


The input circuit of the opamp draws no current, so, on the basis of 
the second line in (14.28), we may write 


0= Y, V, + (Y23 — Yo2/Ko) V; 

Hence, the transfer function of the system is 
K(p) = V/V, = — Yai /L¥23 - Yo2/Ko] 
Assuming that K, > 1, we finally have 





K(p)= — Yi/Yz (14.29) 





Thus, the transfer function of an active RC filter is solely 
dependent on the properties of its passive network; the gain of the 
opamp and its other parameters are excluded from the final 
result. Therefore, the construction of systems varying in frequency 
response reduces to the synthesis of passive RC-networks (in our 
case, a three-port) having the specified frequency response. The 
synthesis of three-ports is not taken up in this book. Therefore, we 
will take a simpler path—we will investigate some specific systems 
arranged in simple circuit configurations, which illustrate the 
circuit-engineering potentialities of the respective class of networks. 

The scale changer. This term refers to the circuit shown in 
simplified form in the schematic diagram of Fig. 14.8. 


Ra 


Input 


Output 





Pe il 
(2) (5) 


Fig. 14.8 Scale changer: (a) schematic diagram; (b) passive three-port 


In order to determine the transfer admittances Y,, and Y,,, let us 
turn to the second line in Eqs. (14.28) and note that, say, Y;, — 
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= ],/V, when terminals 2 and 3 are shorted to ground, that is, for 
V,=V;=0. As is seen from Fig. 14.85, Y,,=1/R,. Similarly, 
Y,, = I/R;. On substituting the two expressions in (14.29), we get 





K(p)= — R;/R, (14.30) 





Equation (14.30) explains the term "scale changer": As is seen, by 
suitably varying the ratio of the resistors R, and R;. the scale of 
gain (amplification) can be changed at will. Naturally, since the 
circuit does not contain any reactive elements, it has no frequency- 
selective properties. 

The analog integrator. If, in the circuit examined above, we 
replace the resistor R, with a capacitor of capacitance C, we will 
obtain a circuit which performs the operation of electric integration 
on the input signal (Fig. 14.9). To demonstrate, from analysis of the 
passive network we find that Y;, — 1/R and Y, — pC. Hence, on 
the basis of Eq. (14.29), we have 





K(p) = —1/pRC (14.31) 





(a) (b) 


Fig. 14.9 Integrator built around an opamp: (a) schematic diagram; (b) 
passive three-port 





Input 
Output 





Equation (14.31) confirms that the circuit has a transfer function 
which is the inverse of p, and so it integrates the signal applied to 
its input. 

The low-pass filter. So that the frequency characteristics of active 
RC filters can be varied at will, it is necessary to use passive 
networks with a greater number of elements than in the above 
cases. An attractive example of a system which has the properties of 
a low-pass filter is shown in Fig. 14.10. An elementary analysis, 
carried out along the same lines as for the above cases, leads us to 
the following expression for the transfer function of the system 


- YN 
Y; (Y, + Y; + Y; + Y4) + YyY, 





K(p)= (14.32) 
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Fig. 14.10 Active RC low-pass filter 


Thus, the task of synthesis reduces to matching the admittances 
of the elements in such a way that the desired frequency 
characteristic is implemented. From the initial specifications, all 
admittances Y, through Y, are either resistors of conductance G or 
capacitors whose admittances are pC. What is important in 
principle is that the transfer function of an active filter is expressed, 
in accordance with Eq. (14.29), by the ratio of two transfer 
admittances Y,, and Y,3. Then the poles of K (p) coincide with the 
zeros of Y,,(p). It is shown in circuit theory [27] that the poles of 
any driving-point or transfer function of a passive RC-network can 
be located only on the negative real axis. However this restriction 
does not apply to the zeros of the corresponding functions, which 
may, as complex conjugate pairs, be located in any part of the left 
half p-plane. Thus, by combining a passive RC-network with an 
opamp, we may synthesize a 2nd-order oscillatory network which is 
the basic element for frequency filters with a variety of frequency 
characteristics. 

As will be recalled (see Chap. 13), the typical transfer function of 
a low-pass filter has the form 


Kp) == 
p) ap? +bp+c 
where Ao, a, b, and c are constants. 

Referring to Eq. (14.32), it is seen that for the transfer function to 
have the above form, Y,, Y} and Y, must be resistors, and Y, and 
Y, must be capacitors. Then, 


— 6,6; 








K(p)= 14.33 
By COLE PCI, + G,+G,) 0,6, ee) 
The poles of the transfer function are located at points 
G,+G,;+G, , .]/G;G 1/G,-G44*-G4V 
P117 — 1 3 44 394 1 3 4 (14.34) 
2C; CC, 4 C; 


The above formula makes it possible to synthesize oscillatory 
elements with any predetermined location of poles. 
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Example 14.4. Synthesize a second-order Butterworth active RC 
low-pass filter with a cut-off frequency Gc — 10° s^ !. 

As is stated in Chap. 13, the transfer function of such a filter 
should have two poles 


P1.2 = @e( — 0.707 + j 0.707) (14.35) 


Let us assume reasonable values for the resistors in the circuit 
and make them all equal, that is R, = R} = R,—1.8 kQ. Then 
G; = G, = G, = 5.55 x 1074 S. 

On equating the real parts of (14.34) and (14.35), we obtain the 
expression defining the capacitance C, 


Gi +G; +G, 
2C, 
Hence, on substituting the known values, we find that C, = 1.18 uF. 


In order to determine the capacitance of capacitor C,, we equate 
the imaginary parts of (14.34) and (14.35): 


G,G, 1 Gib Gs GOV aap 
CC; 4 C; ] 
On solving the above equation, we find that C, — 026 pF. The 


schematic diagram of the synthesized active Butterworth filter is 
shown in Fig. 14.11. 





= 0.7070 
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Fig. 14.11 Active RC-filter with a maximally flat response at a cut-off fre- 
quency of 10? s^! 


Concluding remarks. [n this section we have examined the 
synthesis of active RC filters on the basis of opamps, amplifiers 
with an infinitely high gain. However, this principle does not 
exhaust the capabilities of present-day integrated circuits. Of 
particular interest in this respect are gyrators, active two-ports 
which have the property that when a capacitor is connected to the 
output port, a purely inductive input impedance is synthesized. In 
this way, filters can be built which do not contain any physical 
inductive elements. e 

For the properties of gyrators and other active elements used in The gyrator 
present-day RC filters the reader is referred to [32, 33]. 
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14.4 Self-Excited Harmonic Oscillators. 
The Sma ll-Signal Condition 


In some situations active networks can give rise to periodic 
self-excited oscillations. The term “self-excited” refers to the fact that 
the oscillations are produced and maintained without any external 
periodic excitation of the system. Devices generating self-excited 
oscillations are frequently called self-excited oscillators or, simply, 
oscillators. 

For its operation any oscillator depends on the fact that power 
from an external power supply is fed via an active element, such as 
a transistor, to an oscillatory system (a resonant or tank circuit). 
The signal that controls the transistor is picked off the same 
resonant circuit and applied to the control electrode of the 
transistor over a feedback path. 

With suitably chosen parameters, such a system becomes 
unstable. Any minute oscillations, such as caused by thermal noise, 
tend to grow in amplitude without bound. However, as their 
amplitude builds up, the nonlinear properties of the control element 
begin to play a progressively greater role, so that the amplitude 
reaches a steady-state value and remains practically constant 
afterwards. The oscillator is then said to operate in a steady state. 

The analysis and synthesis of oscillators poses two basic 
problems: 

1. Determine the conditions under which the circuit with 
feedback becomes unstable, that is, jumps into self-excited 
oscillations. 

2. Determine the amplitude and frequency of self-excited 
oscillations in a steady state. 

As will be shown shortly, the first problem is simpler to solve, 
because at the low amplitudes of self-excited oscillations, typical of 
the initial stage of the process, the nonlinear element may be 
replaced with an equivalent linear element. It is more difficult to 
solve the second problem because, in a more general sense, it 
involves an analysis of a feedback system under conditions when 
nonlinear effects may not be neglected. 

Self-excitation of an elementary oscillator. Let us begin our study 
of the processes that take place in oscillators with what is known as 
a transformer-coupled oscillator (Fig. 14.12). 

Referring to the figure, the oscillatory system is an LCR resonant 
circuit, and the feedback element is a coil Ly so placed that the 
magnetic flux it sets up partly threads the coil L. 

Suppose that in one way or another small oscillations have been 
excited in the circuit. If v is the voltage across the capacitor (and, in 
consequence, at the control electrode of the electron device), then, 
by the Kirchhoff second law, we may write the following differential 
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wu 
Fig. 14.12 Transformer-coupled oscillator 


equation to describe the system in question: 


LCd?v/dt? + RCdv/dt + v= + M di/dt (14.36) 
where i is the current in the feedback circuit. The sign on the right- 
hand side of (14.36) is chosen according as the coils L and Ly are 
connected in opposition or aiding. 

Now we will make a basic assumption: Let the control voltage 
v be so small that the electron device may well be replaced with 
a controlled source of current which is a linear function of the 
control voltage: 


(14.37) 


where iy is the direct component of current (of minor consequence 
for the subsequent discussion) and gg is the dynamic (or 
incremental) transconductance defined as the slope of the current- 
voltage characteristic of the electron device at a selected operating 
point. On combining (14.36) and (14.37), we get 


i = io + gqv 


d?v/dt? + (R/LF Mg4/LC) dv/dt + adv = 0 (14.38) 


where oy = 1 M LC is the natural frequency of the lossless resonant 
circuit. It is important to note that Eq. (14.38) is a linear differential 
equation with constant coefficients. By varying the mutual 
inductance M, we can change the coefficient of the derivative dv/dt 
at will The sign and magnitude of the coefficient determine, as will 
be recalled, the character of the free response of (or natural 
oscillations in) this dynamic system. If we choose the upper signs in 
Eqs. (14.36) and (14.38), feedback will lead to regeneration (already 
examined previously). If we let M reach its critical value, Mer 


Ma = RC/ga = 1/090ga (14.39) 


where Q is the Q-factor of the resonant circuit without 


regeneration, then Eq. (14.38) takes the form 
d?v/dt? + oàv =0 
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which is typical of an ideal lossless oscillatory system. If M >M on 
the system becomes unstable. On introducing the parameter 


1 
a = —(Mga/LC — R/L)> 0 


we get the differential equation 
d?v/dt? — 2adv/dt + wav = 0 


which describes  sine-cosine oscillations whose amplitude 
exponentially builds up with time: 


v(t) = Aexp(at) cos y os — a?t + Bexp (at)sin y oi — ot (14.40) 


where A and B are constants which depend on the initial 
conditions. Practically, & « «eg always, so, in accordance with 
Eq. (14.40), the carrier frequency of the oscillations produced in the 
linear mode is very close to the natural frequency of the resonant 
circuit. 

It is important to stress the physical significance of the correct 
choice of the sign in Eq. (14.38): For the system to be capable of 
self-excitation, it is essential that any perturbation of its state 
should produce a feedback signal and that the feedback signal 
should combine with the initial perturbation so as to augment it. 
This is, in fact, the definition of positive feedback as it is treated 
in the theory of oscillatory systems. 

Three-terminal oscillators. A disadvantage of a transformer- 
coupled oscillator is that it needs two inductors. In practice, use is 
more often made of circuits in which the feedback voltage is picked 
off an intermediate tap on the tank circuit. Quite aptly, they are 
called three-terminal oscillators. In the form shown in Fig. 14.13, 
usually called the Hartley oscillator, the intermediate tap is located 
on the inductive element of the tank. 

Let us analyse the condition for the self-excitation of the Hartley 
oscillator. We will do this by developing and solving the 
characteristic equation for the circuit with its feedback loop closed. 

If Vin and Vout are the Laplace transforms of the input and out- 
put signals of the system with its feedback loop open (Fig. 14.135), 


cL 








(a) 


Fig. 14.13 Hartley oscillator: (a) schematic diagram (with the power and 
bias supplies omitted); (b) same, with the feedback loop open 
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and the transfer function of the system is K(p), then the 
characteristic equation describing the closed-loop system has been 
found to be 


K(p)=1 (14.41) 

In order to find K(p), we should note that, for the assumed 
direction of current flow, the voltage across the tuned circuit is 
Vekt — gaZab(p) Vin 


where 


Zab(p) = ktaZ ct (Pp) 


Here, kia = L, AL; + L3) is the tapping-down factor for the tank, 
and Zeķt(p) is the input impedance of the parallel tank between 
points a and c, that is, with connection across the whole of the 
tuned circuit. Deeming the tuned-circuit Q sufficiently high, we 
obtain the following approximate equation: 


| 1 
: F - 
1 + ptckt — JOres Cckt 1 + ptckt + JOres Vckt 








Zck(p) = Real ) (14.42) 


Finally, we note that at the resonant frequency 


Gres = 1//(L, + La) C 


current resonance will exist in the tuned circuit and so 


. 


Vout = — (Lo/L4) Vekt (14.43) 


On combining the above equations, we may re-write the 
characteristic equation (14.41) as 





(Li/Li) kiagaZckt(p) = 1 (14.44) 
Or 
: - + = : (14.45) 
1 + packt — JOres Tekt 1 + ptckt + JOres tckt aga R res 
where a is the coupling parameter defined as 
a = LL, (L; + Lj (14.46) 
Equation E 45) has two complex conjugate roots: 
Re R 
Pi2= agadi res res silfo- ter 2 — (aga R res) (14.47) 
Tckt Tekt 


Thus, it is seen that the Hartley oscillator will jump into 
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self-excited oscillation subject to the condition 


agdRres > 1 


Example 14.5. The tank circuit of a Hartley oscillator is tuned to 
Gres = 6 x 10° s~1. The dynamic transconductance of the electron 
device at the operating point is g4— 7 mA/V. The tank has Q = 40, 
the tank capacitance is C = 400 pF. Find the values of L, and L, 
necessary for the oscillator to jump into and sustain oscillations. 

The characteristic resistance of the tank circuit is 


pl/o;4C-416.60 
Hence, the resonance resistance is 
Rres = pO = 16.6 kQ 


On the basis of Eg. (14.48), for the oscillator to jump into 
oscillation it is necessary that 


a> 1/gaRres = 8.57 x 1073 


Allowing some margin, we take it that a-—10 ?. The total 
inductance of the tank circuit is 

L, + L, = 1/@fes C = 69.4 pH 

Using Eq. (14.46), we obtain a quadratic equation by which we can 
find L,: 

L, (69.4 — L,)/(69.4} = 107? 


which has two roots: L,=0.7 pH and L,=68.7 pH. From 
practical considerations, preference is given to the lower value of L, 
at which the oscillator will obviously develop a higher voltage 
across the tank circuit. 


(14.48) 


L? 


C2 


Another form of the three-terminal oscillator is the Colpitts 
oscillator in which the feedback voltage is picked off the common 
connection of two voltage-dividing capacitors C, and C,. The 
condition for the self-excitation of the Colpitts oscillator is analy- 
sed along the lines similar to those for the Hartley oscilla- 
tor. 

RC phase-shift oscillators*. At frequencies below several tens of 
kilohertz it is increasingly more difficult to use LC resonant circuits 
as tanks for oscillators, mainly because the inductive elements 
become too large in size and weight. It is usual, therefore, to 





* Otherwise called RC harmonic oscillators.- Translators note. 
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employ RC oscillators which are combinations of active two-ports 
(amplifiers) and passive RC feedback networks. 

Let K (p) be the open-loop transfer function and K (p) — 1 be the 
characteristic equation describing the behaviour of a system with its 
feedback loop closed. For the system to be unstable and capable of 
producing harmonic oscillations in a steady state, it is necessary 
that the characteristic equation should have at least one pair of 
complex conjugate roots with a positive real part. The imaginary 
part of the roots will then define the frequency of oscillation. 

Let us derive the condition for the self-excitation of a widely used 
oscillator type with two RC networks (Fig. 14.14). The basic 


R, €, 








(a) (b) 


Fig. 14.14 Oscillator with two RC-networks: (a) schematic diagram; (b) 
same with the feedback loop open 


element of the oscillator is an ideal amplifier which has a real and 
positive gain constant Ky. The amplifier output is connected to its 
input via a passive RC two-port whose transfer function in 
accordance with Fig. 14.14b has the form 


pu 
(1 + pt,)(1 + pt.) + pv 
where 1,=R,C,, t; — R5C,, and v —R;C,. The characteristic 
equation of the oscillator, KyK,(p) 2 1, may obviously be written 
as 
p?t,t2 + p[t, +72 -T(Ky—1)] +1=0 (14.50) 
The system becomes unstable when the coefficient of p crosses 


zero. In other words, for the oscillator to jump into self-sustained 
oscillations it is necessary that 


titta — 1 (K5 —1) «0 








K,(p)= (14.49) 





Hence follows the condition to be satisfied by the gain constant of 
the active element: 





R,C,+R,C, 


K,>1+ 
° R;C, 


(14.51) 





431 


e 

The condition imposed 
on the roots of the 
characteristic equation 


This requirement 
stems from the Routh- 
Hurwitz criterion 


432 


Strictly speaking, the 
frequency of oscilla- 
tion depends on the 
gain of the active ele- 
ment 


A 
Solve Problem 13 


Rres 


9 
The power balance 
around an oscillator 


e 
Internal feedback 


The laser 


Part Two. Circuits 


Notably, if the two RC-networks are the same, the system will jump 
into oscillation at Kg > 3. 

The imaginary part of the roots of Eq. (14.50) depends not only 
on the circuit parameters R,, Ra, C, and C,, but also on the gain 
constant Ky. To determine the frequency of oscillation, it may be 
approximately taken that the oscillator is operating at the 
boundary of excitation, and so the coefficient of p is equal to zero. 
Then from the characteristic equation 


p?t,t, +1=0 


the frequency of oscillation is found to be 


Wose= TR RCC, (14.52) 


In conclusion, it is to be noted that RC phase-shift oscillators are 
inferior to LC-oscillators from the viewpoint of the harmonic 
content of the oscillations generated. This is because the feedback 
loop does not contain any resonant circuits and cannot sufficiently 
attenuate unwanted harmonics. An acceptable waveform of the 
resultant oscillations is secured through variations in the circuit 
design, such as the use of an additional nonlinear feedback loop 
with lag [37]. 

Internal-feedback oscillators. The types of oscillators examined 
aboye include suitably designed positive feedback loops. However, 
it is possible to build oscillators on a different principle, namely by 
introducing a negative conductance in the tank circuit. 

If, for example, Rres is the tank resistance at resonance and 
Gneg = ga « O is the parallel negative conductance corresponding to 
a small amplitude of oscillations, then the condition for the 
self-excitation of the system consists in making up for tank-circuit 
loss (see Chap. 8): 


—gd>1/Rres (14.53) 


Let this condition be satisfied. As the oscillations build up owing to 
the nonlinear element, the rate of build-up slows down. In the 
steady state the power dissipated in the tank circuit over a period 
of natural oscillations is exactly equal to the power fed into the 
tank circuit from external sources over the same time interval. The 
self-regulation of the steady-state amplitude by this mechanism is 
known as internal feedback. 

Distributed-parameter oscillators. Internal-feedback oscillators 
include a very interesting and practically very important variety 
built around sections of distributed-parameter transmission lines. 
A typical example is the laser, the name being derived from the 
initial letters of “Light Amplification by Stimulated Emission of 
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(a) (b) 


Fig. 14.15 Explaining the operation of a laser: (a) sketch; (b) equivalent 
circuit; (1) reflecting mirror; (2) semitransparent mirror 


Radiation.” This is a harmonic oscillator operating at optical 
wavelengths (Fig. 14.15). 

In one form, a laser consists of two plane-parallel mirrors 
which make up a distributed oscillatory .system known as the 
Fabry-Perot resonant cavity. The cavity is usually filled with an 
active medium, such as a mixture of helium and neon. In this 
medium, external pumping produces what is known as population 
inversion, that is, the preponderance of excited atoms over the 
nonexcited ones. On falling to a lower energy level, the excited 
atoms emit quanta of electromagnetic energy at a frequency equal 
to one of the resonant frequencies of the oscillatory system. If the 
emitted power exceeds the power delivered to load through 
a semitransparent mirror, the system jumps into self-sustained 
oscillation. 

In order to get a quantitative idea about the condition for the 
self-excitation of a laser, consider its simple one-dimensional model 
shown in Fig. 14.15b. It consists of a short-circuited 
transmission-line section loaded into a resistor RL. As the theory of 
transmission lines tells us [26], the harmonic wave process in a line 
is described by a complex propagation constant 


y=atjP=/(R, + joLl,)(G, +joC,) (14.54) 


which involves the per unit length parameters R,, G,, L; and C}. 
By the theory of distributed parameter circuits, the effect of 
pumping is customarily interpreted as rendering the per unit length 
shunt conductance negative: G,=—g,. Then, deeming for 
simplicity that R, = 0 and that the conductance only slightly affects 
the phase velocity, that is, g; «@C,, on the basis of (14.54) we 
have 


1 
YR -34ZwtjBo (14.55) 
where Zw = |/ Li = is the wave impedance of the line, and By = 
=o/ L,C, is the phase constant. 


The load resistor is connected in parallel with the input 
admittance of the short-circuited line section of length /, equal, as 
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will be recalled, to 
Yin = (1/Zw) coth yl 
On substituting for y from (14.55) and noting that at x « p 


al — j cot BI " al 
1 —jalcotBl ^ sin?gl 





coth (a! + jl) x jcot BI 


we get 

lí-—giZy . 
Ya = -| — =; — Jcot ol 
Em ( 2sin2Byl 10 Po 


For the system to become unstable, it is required that the 


negative conductance of the line should balance the positive load 
conductance. This leads us to the condition for self-excitation 


(14.56) 





9;!/(2sin*Bol) > 1/Rr. (14.57) 





The frequency of oscillation, @,,,, is found from the resonance 
condition according to which the reactive component of the input 
impedance of the line must vanish: 





cot Boal — 0 
Hence, 
Bol = (x/2)Qk +1) k «0, 1, 2, ... 
Therefore, 
T 
Mosc = —* ——- (2k T 1) 
T 


At the frequency of oscillation, 
|sin Bol | = 1 
so the condition for oscillation takes the form 


As follows from the above expression, the excitation of 
a distributed-parameter oscillator of the type in question becomes 
progressively easier with an increase in the load impedance, that is, 
as the line comes closer to the open-circuit condition with respect 
to the output terminals. 
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14.5 Self-Excited Harmonic Oscillators. 
The Large-Signal Condition 


This section will outline the theory of oscillatory systems 
operating under large-signal! conditions when the nonlinearity of the 
electron device cannot be ignored any longer. The material 
presented is based on an approximate solution of the nonlinear 
differential equation of the oscillator. 

The abridged equation method. We go back to the simplest 
transformer-coupled oscillator and assume that the current-voltage 
characteristic, i — f(v), of the active element is specified or known in 
advance. Since 


di/dt = (df/dv)(dv/dt) 


we may write the nonlinear differential equation (14.36) descri- 
bing the behaviour of the oscillator under any conditions as 
d?p G M df\ dv, 


buc E AL ov 
L Lcd d i 


Methods which would yield an exact solution for an equation 
like that are nonexistent. As a rule, one has to resort to simplifying 
assumptions of physical character and seek approximate solutions. 
In the case on hand, it is useful to note that the oscillator contains 
a high-Q tank, so, despite its nonlinearity, the voltage across 
the tank must resemble a harmonic wave at frequency o very 
closely. 

Let us seek an approximate solution for Eq. (14.58) in the form 


v(t) = V(t)cos Wot 


such that the amplitude V(t) is assumed to be a slow function of 
time in the sense that 


|dVidt |« | V] 


On this basis, in the expression for the derivative 


dv dV ; Vsi i 
= cos@ (6?) sin@ 
dt dt i 2 y 





we may retain only the second term 
dv 


r7 — &gVsin Wot (14.59) 
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Similarly, 
gs ae t— X oF uino t 
oi eR oh — 20,— 
dt^ da" a ° 
2 dV z 2 
— @pV cos Mgt x: — 2097, sin Oot — WV cos Wot (14.60) 


On substituting (14.59) and (14.60) into (14.58), we get what is 
known as the abridged differential equation 


(14.61) 





M d 
DL RUE / \v=0 
dt" 2\ L LC dv 


which approximately describes the events taking place in an 
oscillator using a high-Q tank circuit. 

The abridged equation method simplifies the subsequent steps of 
analysis, because Eq. (14.61) contains only a first-order derivative. 

The mean transconductance. The derivative df/dv in the second 
term of Eq. (14.61) is the local value of the dynamic (incremental) 
admittance of the nonlinear element. Since we assume that the out- 
put signal of the oscillator only slightly differs from a harmonic 
wave at frequency Gy, then the current i(t) is a periodic time 
function expandable into a Fourier series: 


i = f(v) ^ Ig +], cos egt + 1; cos 28gt +... 
On discarding the harmonics, we get 
fx Ig + I, cos Oot 

On the other hand, 


v(t) = Vcos Oot 


and so 
dr od _ py 
dv dt/ dt 


By definition, the coefficient of proportionality between the 
fundamental amplitude of the current and the amplitude of the 
voltage at the control electrode is the mean, or fundamental, 
transconductance gm: 





gm (V) =1,(V)/V (14.62) 





On inserting the mean transconductance, we may re-write the 
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abridged equation (14.61) as 
dV ifR M aig. 
3| Tem ro 


From an analytical point of view, it is more convenient when the 
current-voltage characteristic has the form of a power series: 


(14.63) 


i(v) 2 ag + aqv -F av? +... 

Then, as will be recalled (see Chap. 11), 
I, =a, V+ 3/,a,V3 ?/ga,V5 +... 

so that 


gm (V) = à, + ?/4a5V? + */4asV* +... (14.64) 

On substituting the above expression of the mean 
transconductance in the abridged equation (14.63), we obtain 
a ist-order nonlinear differential equation which can always be 
solved by separation of variables. 

Steady-state operation of the oscillator. By definition, the 
steady-state output signal of an oscillator has a constant amplitude. 
On setting dV/dt =0 in Eq. (14.63), we get 


gm (V) = RC/M (14.65) 


the positive roots of which defige the steady-state amplitude of 
oscillation. 
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the 1930s 


e 

The equation defining 
the steady-state ampli- 
tude of self-excited 
oscillations 


Example 14.6. Consider an oscillator in which the active element 
has the following mean transconductance as a function of the 


amplitude of control voltage: 
8m (V) =a, + ?/4a,V? 


where a, = g4 — 15 mA/V, and a}, = —4 mA/V*. 
The parameters of the oscillator are as follows: 


Gg = 107 s^ !, Q—30, and M=1 pH 


Before we can determine the steady-state amplitude, we should 


first find 


A - 


On the basis of Eq. (14.65), the steady-state amplitude in our case 


satisfies the quadratic equation 
a, t ?/,a5V& — E 
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On solving it, we get 


Vex ae =197V 
[403 
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Soft and hard self- 
excitation 
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The difference between 
the stability of linear 
and nonlinear oscilla- 
tory systems 
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The characteristic gm,(V) may have any one of the two forms 
shown in Fig. 14.16, depending on where the operating point of the 
nonlinear element is located. 

If the mean transconductance monotonically decreases with 
increasing amplitude of the control voltage, the oscillator is said to 
be operating with soft self-excitation. The respective plot is shown 
in Fig. 14.16a which also shows the so-called feedback line-a 
horizontal line whose ordinate is RC/M. The intersection of the 
gm, (V) curve and the feedback line defines the only amplitude of 
steady-state oscillation, Vss. 


8m1 


RCIM RC/M 





0 Vs Vss2 

(a) (5) 
Fig. 14.16 Typical plots of mean transconductance versus the amplitude of 
control voltage: (a) "soft mode" characteristic; (b) "hard mode" 
characteristic 


The situation is more complicated when the oscillator is 
operating with what is called hard self-excitation. Here, as is seen 
from the plot in Fig. 14.165, two steady states are possible, one 
with amplitude V4,. and the other with amplitude Veg). 

Stability of steady states. In order to see which of the two steady 
states is actually effected, we must define the crucial matter of their 
stability. An oscillatory process is said to be in a stable steady state 
if, after any small deviations of the amplitude of harmonic 
oscillations from the steady-state value, the system tends to go back 
to the state in which the amplitude is steady. Conversely, the 
process associated with an unstable steady state will tend to change 
its amplitude so as to move to another stable point. 

The stability of a steady state is a concept specific of nonlinear 
oscillatory systems. It should be recalled that with reference to 
a linear dynamic system, we may only speak of stability or 
instability in the quiescent state (the small oscillation condition). 

Consider the abridged equation (14.63) of the oscillator and 
assume that the amplitude V of self-sustained oscillations has 
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departed by a small amount U from the steady-state value: 
V= Vist U (14.66) 
Then 

gm (V) & Jm (Vs) + AU 

where A = dg»,/dV is the slope of the mean transconductance curve 


at the steady-state point. On substituting (14.66) into (14.63), we get, 
subject to Eq. (14.65), a differential equation in the amplitude 


increment 

dU AM AM Vss 

— = ———(U? -UV4)z———U 14.67 
dt 2LC | + UVss) 2LC ( ) 


This simple linear differential equation points out that the sign of 

the derivative dU/dt depends on the sign of A. Thus, if A <0, then B : 
U and dU/dt take different signs. Therefore, if, for one reason or The steady-state stabi- 
another, the amplitude V of the oscillation has become greater than lity criterion 

Vss, that is, U >0, then, by virtue of Eq. (14.67), the derivative 

dU/dt « 0, and so with time the oscillatory system will regain its 

steady state. 

It is easy to see that an oscillator operating in the soft  |5m! l 
self-excitation mode does possess the above property. Suppose that 
the mutual inductance M is so small that the feedback line 1 does 
not intersect the gm, (V) curve. The only steady state available to 3 
the system now is the quiescent state where the oscillations have 
zero amplitude. If M is increased, then at Mer = RC/gg (line 2) the V 
oscillator will excite itself, no matter how small the amplitude of 9 
steady-state oscillation may be. Any further increase in M will lead 
to a gradual increase in the amplitude of the resultant oscillations 
(line 3). 

The events take a different course in an oscillator operating in 
the hard self-excitation mode. If initially the system is in the 
quiescent state and the feedback line takes up position 1, then no 
self-excitation will occur, despite the fact that there are two 
steady-state points, namely the unstable point a and the stable 
point b. If, however, some external sources drive the system into 
harmonic oscillations at resonant frequency and with an amplitude 
corresponding to point a, then, since A>O (the mean 
transconductance increases with increasing amplitude), the resulting 
oscillations will be unstable. Their amplitude will build up only 
until the system has moved to the stable point b characterized by 
a constant steady-state amplitude Veg). 

An oscillator with hard self-excitation is capable of jumping into 
self-sustained oscillations as well. For this to happen, the feedback 
line must take up position 2 in which the steady state with an 
infinitesimal amplitude of oscillations is unstable. As follows from 
the foregoing, the oscillations thus excited will keep building up 


N 
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until their amplitude reaches in the limit the steady-state value Ves). 
If we now reduce M, the amplitude of oscillations will gradually 
diminish until it is equal to Veg3, and the feedback line takes up 
position 3 in which it is tangent to the gm,(V) curve. Any further 
decrease in M results in quenching the self-excited oscillations; their 
amplitude suddenly drops to zero. 

Thus, in an oscillator with hard self-excitation, oscillations occur 
and disappear at various values of the feedback factor. This 
property is called oscillatory hysteresis. 

Dependence of soft and hard self-excitation of an oscillator on 
the location of the operating point. As already noted, the soft 
self-excitation mode differs from the hard mode in that at small 
amplitudes of oscillation the mean transconductance gj (V) 
decreases with increasing V in the former case and increases in the 
latter case. Let the current-voltage characteristic of the nonlinear 
element be described by a power series. Then (see Eq. (14.66)), at 
low values of V the following relation exists: 


Jm (V) = a, + ?/4a,V? 


from which it follows that the oscillator operates in the soft mode 
when a, « 0, or in the hard mode when a, > 0. As will be recalled, 


1 di 


a, = —— 
3! dv? 


with the derivative being evaluated at the point corresponding to 
the initial bias voltage applied to the nonlinear element. 

As a rule, a plot of i(v) yields a smooth curve monotonically 
increasing from zero to some constant level. If we differentiate this 
relation three times graphically, we will see that the soft mode is 
realized when the operating point is located in the middle portion 
of the characteristic. 

Transition to a steady-state amplitude. The abridged equation 
method makes it possible not only to find steady states and to 
analyse them for stability, but also to investigate the transition of 
the system to the steady-state amplitude of oscillations. To illustrate 
the method, let us find the manner in which the amplitude V(t) 
varies with time in an oscillator operating in the soft mode, 
assuming that at t=0 the system sustains harmonic oscillations at 
resonant frequency and some known amplitude V). 

The problem reduces to solving the equation 


dV 1/R Ma, 3aM,, 
_ Ma, "P 
d '2VL LC  4LC ) 





subject to V(0) 2 Vo. 
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Let us introduce abbreviated notation: 








_1 (Ma, RJ) 

edic EP 
3a4M 

P=3rc 79 


We can multiply both sides of the abridged equation 
= = (x + BV?) V 
by V and obtain an equivalent form: 

dy? 

2(a+ BV?) V? 

By expanding the left-hand side of (14.69) into partial fractions, 
we get 

— (B/2a) dV? 

a+ BV? y? 

Finally on integrating subject to the initial condition, we 
obtain the solution of the problem as 

1 in V? (a + BV2) » 
2a  V$i(a-c BV?) 


Hence, the final result is 


(14.68) 


- dt (14.69) 


dV^/2 
E dr (14.70) 








o V, V a exp (at) » 
i ya + BV2 [1 — exp 2at)] 





Wt) (14.71) 








As t tends to infinity, the amplitude of oscillations tends to 
a constant steady-state level 


——— RC/M —a 
ra Va B= | 7 
/443 

which checks with the result obtained in Example 14.6. 

It is important to note that the steady-state amplitude of self- 
sustained oscillations does not depend on the initial conditions. If 
V, =0, then, in accord with (14.71), the amplitude V(t) is zero for 
any t > 0. However, since at « > 0 the state of small oscillations is 
unstable, the self-excitation of the oscillator will always take place 
with any value of Vj, however small, arising, say, from thermal 
noise. 


Lastly, it is to be noted that with increasing Q-factor of the 


(14.72) 
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onare treated similarly 


E 

The difference between 
active and passive 
oscillatory systems 


442 


e 
The phase portrait 


Part Two. Circuits 


tank, when R tends to zero, the parameter « increases, too. This, in 
turn, implies that the transition to a steady-state amplitude 
proceeds faster at higher values of the tank Q (see Eq. (14.71)). It is 
useful to recollect that the passive narrowband systems studied in 
Chap. 9 have diametrically opposite properties. In their case, given 
a nonsteady process, the envelope varies progressively more slowly 
as the Q of the system is increased. 

The phase-plane method. In radio engineering and radio 
physics, a special graphic method is used to describe and interpret 
the behaviour of oscillatory systems, notably oscillators. It is known 
as the phase plane method (or phase plane analysis). The rationale of 
the method can best be explained by taking the already studied 
2nd-order linear oscillatory system as an example. 

Free oscillations in the system are described by the equation 


d?x/dt? + 20 dx/dt + 2x = 0 (14.73) 


where the unknown function x may be a voltage, a current, etc. 
From the theory of differential equations it is known that by 
specifying x and dx/dt at any instant, we can fully describe the 
subsequent run of the process in the system. The graphical 
representation of the process will be the motion of a representative 
point along a curve (a phase trajectory) lying in the Cartesian x, 
x'-plane. This plane is called the phase plane of the system. 

For each set of initial conditions x and x' there is only one 
phase trajectory. If we take many different values of initial 
conditions, we will obtain an infinite number of nonintersecting 
phase trajectories which together form what is known as the phase 
portrait of the system. 

The phase trajectories for Eq. (14.73) are fairly simple to 
construct because we know the general solution 


x(t)= Aexp( — at) cos (@nt + ©) 


where A and ọ are the constants dependent on the choice of the 
initial conditions; o, = |/o$ — o? is the natural frequency. For 
AOp, we approximately have 


dx/dt x — og Aexp( — at)sin(ont + Ọ) 


It is convenient to introduce the variable y =(dx/dt)/o,. Then 
the oscillatory process in the system will be represented by two 
time-dependent projections of the representative point on the x- 
and the y-axes: 

x(t) = Aexp( — at)cos(o, t + ©) 
(14.74) 
y(t) = — Aexp( — at)sin (o, t + 9) 


It is easy to see that Eqs. (14.74) describe a logarithmic spiral 
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whose radius vector exponentially decreases in time as A exp( — at), 
if a — 0 (the process is decaying). The representative point moves 
clockwise; the polar angle of the vector, — ost — 9, varies linearly 
with time. With t tending to infinity, the representative point spirals 
towards the origin, which corresponds to a state of stable 
equilibrium. 

If « « 0 (the process is building up), the phase trajectory spirals 
away from the origin, and this 1s an indication that the system is in 
a state of unstable equilibrium. 

Finally, if x — 0 (there is neither a build-up nor a decay of the 
process) then in our idealized system the representative point will 
be continuously moving round a circle whose radius depends on 
the choice of the initial conditions. 

Phase portraits of oscillators. Plotting phase trajectories for 
a nonlinear equation of the form in (14.58) which describes an 
oscillator may prove an extremely tedious problem solvable only by 
numerical or graphical methods. If, however, the Q-factor of the 
oscillator tank is high and the oscillations generated are close in 
waveform to harmonic, we will see that the phase plane contains 
a closed curve called a limit cycle, around which the representative 
point moves in the steady state. The radius of the limit cycle is 
equal to the amplitude of steady-state self-sustained oscillations and 
does not depend on the initial conditions. 

Limit cycles may be stable and unstable. An oscillator operating 
in the soft self-excitation mode has only one limit cycle which is 
stable. To demonstrate, if initially the amplitude of oscillations is 
greater than its steady-state value, then, as time passes, the phase 
trajectory will spiral towards the limit cycle. By the same token, the 
amplitude of oscillations will build up if initially it was smaller than 
the value corresponding to the radius of the limit cycle. 

The situation is more complicated for an oscillator with hard 
self-excitation. Now there are two limit cycles, / and 2, of which 
cycle 7 has a smaller amplitude and is unstable while cycle 2 is 
stable. If initially the representative point is inside cycle 1, the phase 
trajectory will spiral towards the origin. Therefore, some external 
force is needed in order to excite the oscillator. If, on the other 
hand, the representative point is located outside the unstable limit 
cycle 1, the phase trajectory will spiral towards the stable limit 
cycle 2. 


Summary 
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4€ Feedback is widely used to build dynamic systems which will have a specified fre- 


quency or impulse response. 


<*> There may be positive-feedback and negative-feedback systems. 
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The use of negative feedback in an amplifier makes it possible to build systems with 
a highly stable gain. 

Negative feedback minimizes the nonlinear distortion arising from the nonlinear 
current-voltage characteristics of active elements. 

Negative feedback makes it possible to expand the bandwidth of an amplifier owing 
to a decrease in the gain level. 

The stability of small oscillations in feedback systems is analysed with the aid 
of stability criteria. Most frequently, these are the Routh-Hurwitz and Nyquist cri- 
teria. 

Active RC filters are frequency-selective devices containing no inductive elements. 
When positive feedback is applied to an amplifier, instability may arise. If the circuit 
contains an oscillatory system (a tank circuit), an unstable positive-feedback amplifier 
becomes a harmonic oscillator. 

Where the objective is to generate low-frequency harmonic oscillations, resort is ma- 
de to RC phase-shift oscillators which do not contain any resonant (tank) cir- 
cuits. 

In an oscillator the steady-state amplitude of oscillations 1s decided by the form of the 
nonlinearity displayed by its electron device. 

Oscillators may reside in a stable and an unstable steady state. Also, they may operate 
with hard and soft self-excitation. 


Review Questions 


1. 


Formulate the principle by which feedback is classified in dynamic systems. Is it possible 
that in one and the same system feedback is positive at one frequency, and negative at 
some other? 

List some of the engineering applications of negative feedback in amplifiers. 

What is the salient feature of the frequency response of an amplifier using delayed 
feedback? 

Formulate the Routh-Hurwitz and Nyquist stability criteria. 

List the most important properties of operational amplifiers. 

Why is it that the connection of the output in an operational amplifier to its 
noninverting input disturbs its stability? 


. Draw schematic diagrams for the scale changer and the analog integrator built around 


an opamp. 


. There is a breadboard version of a transformer-coupled oscillator. The oscillator fails to 


be excited, although it has been assembled from the components known to be good. 
How would you proceed with the alignment of the oscillator? 


. Draw schematic diagrams for the Hartley and Colpitts oscillators. 
. Does the frequency of the oscillations generated by an RC oscillator depend on the gain 


constant of the active element? 


. What is the condition of oscillation for an internal-feedback oscillator? 
. Define the mean transconductance of an electron device. 


What is the fundamental difference between the soft and hard self-excitation of an 
oscillator? 

If the current-voltage characteristic of a nonlinear active element is known, how can you 
determine the boundary between the soft and hard modes of self-excitation? 
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Problems 


1. In a feedback system, the forward-path 
element has a frequency-independent gain 
K, = 1000. The gain of the feedback loop 
(feedback ratio) is 


Bo =5 x 107 *exp(—j 45°) 


Determine what kind of feedback, positive 
or negative, exists in the system. 

2. An amplifier has a frequency- 
independent gain of Ky = 10000. When the 
ambient conditions (say, the temperature) 
change, the gain changes too, such that 
AK,/Kgy-—0.2. The system parameters are 
stabilized by negative feedback. Find the 
value of the feedback ratio B for which the 
instability in the gain is reduced by a factor 
of 10, that is, to AKm/K = 0.02. What is 
the closed-loop (overall) gain of the system 
in the circumstances? 

3. Demonstrate that in the amplifier 
shown in the accompanying diagram 


+E 
| | sup 





there is negative feedback such that 

B° = — Rø/RL 
Hint: Use an auxiliary voltage v between 
the base and the emitter (see the diagram) 
and note that the a.c. component of 
emitter current is 


lg — gu v 
4. Find the voltage-ratio transfer function 
K = dout/Vin 
in the 


of the emitter follower shown 


accompanying diagram: 
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Hint: The transconductance g, of the 
transistor should be assumed known. 

5. In a single-stage RC-loaded amplifier, 
Rp 1.6 KQ. The stray capacitance C, in the 
collector lead is 50 pF. The trans- 
conductance of the transistor is gm= 
= 30 mA/V. The emitter lead contains 
a feedback resistor Ræ = 27 Q (see Problem 
3). Find the upper and lower cut-off fre- 
quencies of the amplifier with and without 
negative feedback. 

6. Using the Routh-Hurwitz criterion, 
analyse the stability of small oscillations in 
a dynamic system described by the 
characteristic equation: 


(a) p*+3p?+2p?+p+1=0 
(b) p^ + 2p? + 3p? +p+1=0 


7. Using the Nyquist criterion, analyse 
a delayed-feedback system (see Fig. 14.4) for 
stability. 

8. Using the Nyquist criterion, analyse for 
stability the closed-loop system containing 
two ideal amplifiers each of gain Kj: 





9. Find the transfer function of the system 
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shown below: 





10. An analog integrator built around an 
opamp (see Fig. 14.9) has the following 
parameters: R=2.7 kQ, C=1.8 nF. The 
opamp draws its power from a power 
supply with Esyp= 12 V. The signal applied 
to the integrator input is vig = O.lo (t). Find 
the output signal and determine the time 
required for the output voltage to reach the 
supply voltage level. 

11. Synthesize a second-order Chebyshev 
active RC low-pass filter, the initial 
specifications being w,.= 1.5 x 10? s^! and 
g — 0.75. 

12. The transformer-coupled oscillator of 
Fig. 14.12 uses a tank circuit tuned to fres = 
— 400 kHz. The element values of the tank 
are L=15 uH and R=8Q. The dynamic 
transconductance of the transistor is gg= 
— L5 mA/V. Find the critical value of 


mutual inductance M assuring the 
self-excitation of the system. 
13. The RC oscillator of Fig. 14.14 


generates harmonic oscillations at 250 Hz. 
Select the element values necessary for the 
oscillator to operate at the frequency stated, 
assuming that the oscillator is operating at 
the boundary of excitation. 

14. The current-voltage characteristic of 
a transistor is approximated by two straight- 
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line segments: 
0 ic, mA 


25 


x Í Vge, V 
0.25 0.5 0.75 
Construct a plot of the mean transcond- 
uctance gm, as a function of the amplitude 
of the high-frequency voltage V, assuming 
that the operating point is at V5 = 075 V. 
15. The harmonic oscillator shown 
schematically in the accompanying diagram 





(CN 
(NE 
sup 

uses a transistor whose characteristic is 

given in Problem 14. The circuit parameters 

are og = 105 s71, Q = 50, M «02 uH, and 

V, — 0.75 V. Find the steady-state amplitude 

of oscillations. Construct approximate plots 

of the steady-state amplitude as a function 

of the mutual inductance and the bias 
voltage. 

16. In the oscillator of the previous 
problem the initial bias is set at 0.25 V. 
Show that the system will operate with hard 
self-excitation. Find M at which the 
steady-state amplitude of oscillations is 1 V. 
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Advanced Problems 


17. Show that the feedback system in 
Fig. 14.1 can be described by an infinite 
relation of the form 


Vout = KVin 
+ B(KVin + B(KVin+ B(KVin + -.- 


relating the Laplace transforms of the input 
and output signals. Inquire into the 
equivalence between the above 
representation and Eq. (14.2). Discuss the 
treatment of the processes in a feedback 
system as the circulation of signals round 
the feedback loop. 

18. Plot the Nyquist locus and, using the 
Nyquist stability criterion, investigate the 
stability of a three-stage RC-coupled 
amplifier, assuming that the output of the 
system is directly connected to the input. 

19. Investigate the condition of 
self-excitation for a RC phase-shift oscillator 
set up as shown in the accompanying 
diagram: 
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Derive an expression for the frequency of 
oscillation, neglecting the effect of the gain 
of the active element on the imaginary part 
of the roots of the characteristic equation. 

20. Analyse the steady-state amplitude of 
oscillations in a  distributed-parameter 
oscillatory system, assuming that the per- 
unit-length shunt conductance which 
describes the effect of the active medium is 
defined by 


G= —g,+aV? 


where g, and « are constants, and V is the 
amplitude of h.f. oscillations. 

21. Show that the transfer function of 
a bandpass filter is realized by the circuit of 
the form shown below: 





Chapter 15 


Discrete Signals. 
Principles of Digital Filtering 


The difference between discrete and continuous (analog) signals 
has been underlined in Chapter 1 when considering the 
classification of signals. It is worth while to recollect the basic 
property of a discrete signal: Its values are defined at a countable 
set of points (..., to, t4, t2, ...) rather than for all instants of time. 
Therefore whereas an analog signal x(t) is represented by 
a mathematical model possessing the usual properties of a smooth 
function, a discrete signal xq(t) is described by a series (..., xo, x,, 
X5, ...) of its values at points (..., tọ, ti, t5, ...), respectively. 

Discrete signals arise naturally in cases where a message source 
generates information at fixed instants of time. Typical discrete 
signals are the air temperature data transmitted by broadcasting 
stations several times a day. The salient feature of discrete signals is 
displayed here with utmost clarity: Between the broadcasts there is 
no information available about the quantity involved, although the 
air temperature is changing all the time in a quite gradual manner. 
Thus, the measured data are the outcomes of a special procedure 
by which a continuous quantity is converted into a series of discrete 
values. This procedure is called sampling, and the data thus 
generated are the samples of a continuous signal. 

Discrete signals have come to the fore in recent decades in the 
wake of advances in communications engineering and in data 
processing on high-speed computers. As a corollary, specialized 
computing devices have been developed, specifically adapted to 
process digital information and known as digital filters. 

This chapter will be concerned with the principles underlying 
a mathematical description of discrete signals and the theoretical 
foundations on which the synthesis of devices for digital data 
processing is based. 


15.1 Discrete Pulse Sequences 


For the first time discrete signals came into use in the 1940s with 
the advent of pulse-modulated communication systems. A salient 
feature of pulse modulation is the fact that the carrier is a periodic 
train of short pulses rather than a continuous harmonic wave. 

Principle of pulse modulation. Consider the simple pulse 
modulator shown in block-diagram form in Fig. 15.1. 

Referring to the figure, the pulse modulator is a device with two 
inputs. One input accepts the original analog signal x(t) to be 
sampled. The other input is fed a periodic train of short 


Ch. 15 Principles of Digital Filtering 










Pulse Xa(t) 
modulator 






Sync pulse 
generator 





Fig. 15.1 Block diagram of a pulse modulator 


synchronizing (sync) pulses equidistantly spaced in time, the spacing 
A being known as the sampling interval. The modulator is arranged 
so that each time a sync pulse is applied, the instantaneous value of 
x(t) is measured, or sampled, and a short pulse whose area is 
proportional to the sample, appears at the output of the device. 

From the above principle, we may write the following 
mathematical model for the discrete, or sampled, waveform 
produced by pulse modulation: 


x 


xa(t)}= Y. x(kA)8(t — kA) (15.1) 


k-2-a« 


It is to be noted that from a formal mathematical point of view 
the shape of the pulses that make up the output signal is entirely 
immaterial. For example, these pulses may all be of the same 
duration while their amplitude varies in proportion to the 
instantaneous values of the original waveform at the sampling 
points. This form of modulation has come to be known as pulse- 
amplitude modulation (PAM for short). There is another procedure 
called pulse-width, pulse-duration or  pulse-length modulation, 
(abbreviated PWM, PDM or PLM), in which the output pulses are 
of a constant amplitude, but their width (duration or length) is 
directly proportional to the instantaneous values of the analog 
signal. 

The choice of a particular form of pulse modulation is dictated 
by engineering considerations (ease of physical implementation) and 
by the character of the signals being transmitted. For example, the 
use of PAM may be unwarranted if the original modulating signal 
varies between broad limits or, as is usually said, it has a broad 
dynamic range. The point is that a faithful transmission of such 
a signal would require a transmitter in which a rigorously linear 
relationship is maintained between the amplitudes of the input and 
output signals. This constraint is nonexistent in PWM systems, but 
they are more difficult to implement engineeringly than PAM 
system. 
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The sampling interval 


With this model, the 
values of the signal 
between sampling in- 
stants are assumed to 
be zero 
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As already noted in Chap. 1, the most important use for pulse 
modulation is in time-division-multiplex (TDM) communication 
systems. 

A further advantage of pulse modulation is that it assures a high- 
er noise immunity as compared with the cases where the carrier is 
a simple harmonic wave. 

The spectrum of a digitized (sampled) waveform. Let us look into 
the spectrum transformation that takes place when an arbitrary 
analog signal is sampled. To this end, we refer to Eq. (15.1) and 
note that the digitized (sampled) signal xq(t) is the product of the 
original wave x(t) and the so-called sampling sequence 


20 
n(ü- Y 8(t—kA) (15.2) 
k=—@ 


formed by delta impulses following at equal time intervals A. As 
will be recalled, the spectrum of the product of two signals is the 
convolution of their individual spectra (see Chap. 2). Therefore, 
since we know how the signals and their spectra are related to one 
another: x(t)9Sx(o) and 1(t}+S,(@), we may conclude on the 
basis of Eq. (2.35) that the spectrum of the sampled waveform, 
Sxa(@), is equal to 


| 2 
Sxalo)= > Sn (0) Sx (© — 5) dë (15.3) 


In order to find the spectrum of the sampling sequence, Sn (©), 
we expand the periodic function y(t) into a Fourier series: 


x 


n(t)= ; C, exp (j 2nnt/A) 


n= 


The coefficients of the series (the Fourier coefficients) are given by 


A/2 

1 

Cn=— J 8(t)exp(—j2nnt/A)dt=1/A 
A -Aj 


Referring to Eq. (2.42), we get 


oo 
2n 


X Y 6(mo-—2nn/A) (15.4) 





Sy (@) = 


That is, the spectrum of the sampling sequence consists of an 
infinite series of delta impulses displaced along the frequency axis 
so that they are separated by an interval equal to 2n/A (s^ !). 

Finally, on substituting (15.4) into (15.3) and reversing the order 
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of summation and integration, we get 


ac 


1 
Sxa()m b _Sx(@—2nn/A) (15.5) 


Thus, the spectrum of the sampled waveform consists of an infinite 
succession of repetitions of the spectrum of the original waveform 
(to within the negligible scale factor 1/A). These repetitions are 
displaced along the frequency axis so that they are separated by the 
interval 2n/A, equal to the angular sampling rate (Fig. 15.2). 










(a) |Sxq(w)| 
A 
E ISx (o) 
-Om/A RA 0 n/A IRIA 
|Sxd(w)| 
JN : 7*6 ÁN 
! | A fi ! w 





—2R/A —R/A 0 n/A 2n/A 


Fig. 15.2 Spectra (green areas) of the sampled waveform for two values of 
the upper frequency limit in the signal spectrum: (a) upper frequency limit 
exceeds half the sampling rate; (b) upper frequency limit is less than half the 
sampling rate 


The reconstruction of a continuous waveform from a sampled 
waveform. If oy is the upper frequency limit in the spectrum of the 
original waveform, then, as can be seen from Fig. 15.2, for ou < 
< T/A, the individual lobes of the spectral diagram do not overlap 
any longer. Therefore, it is possible to reconstruct the original 
continuous waveform by passing the sampled waveform defined in 
(15.1) through a low-pass filter. The maximum allowable sampling 
interval will then be A = z/ow = 1/2fu, which completely agrees with 
the sampling theorem. 

Let the filter used to reconstitute the original continuous 
waveform have the frequency response function 


0, o < — 0 
K (jo) 24 Ko, — Quy € 0 € Oy 


0, (0 > Oy 
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The amplitude factor 
has been chosen to 
make the result more 
instructive 


The reconstruction fil- 
ter may be a high- 
order Butterworth low- 
pass filter 
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Its impulse response is then 


| x 
hio f K(jo)exp(jot)do — (Ksou/n)sin (@ut)/out 


On setting Ky — r/oy and noting that the sampled waveform 

defined in (15.1) is the weighted sum of delta impulses, the 

waveform at the output of the reconstituting filter is found to be 
= sin@y(t — kz/o) 


y(t)= za . x (kA) ait unm] (15.6) 





which, in accord with (5.18), is an exact repetition of the original 
bandwidth-limited waveform x(t). 

An ideal low-pass filter is not physically realizable and can only 
serve as a theoretical model with which we can explain the 
principle of reconstituting a continuous waveform (the original 
message) from its discrete samples, or the sampled waveform. A real 
low-pass filter has an amplitude (magnitude) response which either 
encompasses several lobes of the spectral diagram or is 
concentrated near the zero frequency and is substantially narrower 
than the central lobe. As an example, Fig. 15.3 shows waveforms 
illustrating the reconstruction of a sampled signal by means of an 
RC network. As seen, a real reconstruction low-pass filter inevitably 
distorts the original waveform. 

It is to be noted that signal reconstruction could utilize not only 





nA 1 
(e) " Uu» 


Fig. 15.3 Reconstruction of a continuous waveform from its samples with 
an RC-network: (a) filter schematic; (b) sampled waveform; (c and d) 
amplitude response of the filter and the signal at its output for RC>A; (e 
and f) same for RC«A 
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the central, but any side lobe of the spectral diagram. In addition to 
low-pass filtering, however, this would necessitate resort to fre- 
quency transformation or synchronous detection. 


15.2 Digitization of Periodic Signals 


In signal analysis by computers, the following situation is typical: 
A continuous signal x(t) is specified over a time interval (0, T) by 
its sampled values (xo, X;,..., Xy — 1) taken respectively at times (0, 
A, ..., (N — 1) A); the total number of sampled values is N — T/A. The 
collection of these numbers, real or complex, is the only 
information from which we can judge about the spectral properties 
of the signal x (t). The procedure by which such discrete signals are 
analysed consists in that the collection of sampled values is 
repeated mentally an infinite number of times. Ás a result, the 
signal becomes periodic (Fig. 15.4). 





01234..... NTI 


Fig. 15.4 Sampled representation of a periodic signal 


On assigning to this signal a particular mathematical model, we 
can use an expansion into a Fourier series and find the 
corresponding amplitude (Fourier) coefficients. The collection of 
these coefficients forms the spectrum of the periodic discrete signal. 

The discrete Fourier transform. Let us use a model in the form of 
a series of delta impulses and assign to the original waveform x(t) 
its discrete representation on the inverval (0, T): 

N-1 
xa(t)= Y, xxó(t—kA) (15.7) 


k=0 
where xy-— x(kA) are the sampled values at the kth points. 
Now we represent the discrete model in (15.7) by a complex 


Fourier series 
oC 


xa(t)= X C, exp (j2nnt/T) (15.8) 


in which the Fourier coefficients are defined as 
T 


Cn= [xa (expl — j2nnt/T)dt (15.9) 
0 
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On substituting (15.7) into (15.9) and introducing a dimensionless 
variable č = t/A, we obtain 
; NAN-1 
C,——— f X xxó(t — kA)exp( — j2nnt/T)dt 
N A 0 k=0 


1 NN-I 
= J E x96 - Bexp( —j2nnE/N)dE 


1 N-i N 
=a MÀ xf 8 — Kexp(—j2nng/n)dé 


Finally, by utilizing the filtering properties of the delta-function, 
we have 


N 


-1 
C,—. Y xgexp(—j2nnk/N) (15.10) 
N £o 


Equation (15.10) defines the series of coefficients which form the 
discrete Fourier transform (DFT) of the signal. This transform has 
the following obvious properties. 

1. The discrete Fourier transform is a linear transform, that is, 
a sum of signals can be represented by the sum of their individual 
discrete Fourier transforms. 

2. The number of Fourier coefficients Co, C1, ..., Cy... , found 
by Eq. (15.10) is equal to the number N of sampled values in the 
collection. Thus, for n= N, Cyn = Co. 

3. The coefficient C, (the constant component) is the mean value 
of all sampled values: 


1 N-1 
CoS ar P Xk 


4. If the number N of samples is even, then 


5. If the sampled values x, are real numbers, then the Fourier 
coefficients located symmetrically about N/2 form complex 
conjugate pairs: 

| N- 
Cn-n=— », xkexp[ —j2n(N — n)k/N] 
0 


k= 
p N-i 

2 Y, xkexp(2nnk/N) = C$ 
k=0 
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Therefore it is legitimate to think that the coefficients Cn/.+,,..-, 
Cy —; correspond to negative frequencies. In the analysis of the 
amplitude spectrum of a signal they do not play any role, so they 


need not be calculated. 


e 
The number of harmo- 
nics being found 








Example 15.1. Over its periodicity interval a sampled signal is 
specified by six equidistant samples (xy) = (1, 1, 1, 0, 0, 0). Find the 
coefficients of the discrete Fourier transform for this signal. 

Using Eq. (15.10), we directly calculate: 

3 


Co=—=0.5 
976 


C, 2 ZF 1x eI px ec m5 Ll — 9/3) 


1 ; 
ae l +1 xe 205. 4x c7) 4) — 0 


1 ; ; 1 
CG =— (1+0 T en =— 
3 gut + 6 


The remaining coefficients are found on the basis of their 
conjugacy: 


1 2 
C,-Cf-0, C,-Cf-c( +jV3) 


Thus, since we have a sampled signal with N = 6 samples, we can 
find the constant component and the complex amplitudes of the 
fundamental, the second and third harmonics of the original 
continuous waveform. Clearly, with any even number N, the 
number of harmonics thus found account for half the sampled 
values. This stems directly from the Kotelnikov sampling theorem. 
To demonstrate, the upper frequency limit in the spectrum of the 
sampled waveform is fyu=1/2A)=(N/2)f,, where f, =1/T is the 
fundamental frequency. 





The reconstruction of the original waveform from its discrete 
Fourier transform. Once the discrete Fourier coefficients (Co, C,, 


Cassis Cyn 2) have been found from the collection of samples (xo, 

%1,+.., XN — 1) Of a real signal, we can always reconstruct from them 

the original waveform x(t). Obviously, the Fourier series of such Jt ig assumed in ad- 

a signal takes the form of a finite sum vance that the original 
signal satisfies the con- 

x(t) = Co + 2| C, | cos (2nt/T+ 9) + 2| C,|cos(4nt/T+ o) ditions of the Kotelni- 


kov (sampling) theo- 


+...| Cnj/,|cos(N nt/T-- ou) (15.11) rem 
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Fig. 15.5 Signal reconstituted from discrete Fourier transform coefficients 


where qj — argC; are the phase angles of the corresponding Fourier 
coefficients. As an example, Fig. 15.5 shows a signal x(t) 
reconstructed from its samples in accordance with the data given in 
Example 15.1. On the basis of Eq. (15.11), this signal may be 
defined as 


x(t) + + Lcos (2nt/T— 1/3) + cos (6nt/T) 


It should be especially stressed that the reconstruction of 
a continuous waveform by Eq. (15.11) is not an approximate, but an 
exact operation fully equivalent to obtaining the instantaneous 
values of a band-limited signal from its samples making up the 
Kotelnikov series. In some cases, however, it is preferable to use the 
procedure based on the discrete Fourier transform, because it leads 
to finite sums of harmonics, while the Kotelnikov series for 
a periodic signal must in principle contain an infinite number of 
members. 

The inverse discrete Fourier transform (IDFT). The task of 
discrete spectral analysis may be stated in a different way. Suppose 
that the discrete Fourier coefficients C, are specified in advance. 
Also let us set t — kA in Eq. (15.8) and note that the sum is taken 
only over a finite number of members in the series, which 
correspond to the harmonics contained in the spectrum of the 
original waveform. Hence, we obtain an equation for sampled 
values 


N-1 
xk= Y, Cyexp(2nnk/N) (15.12) 


n=0 


which defines the algorithm of the inverse discrete Fourier transform 
(IDFT). 
The mutually complementing equations (15.10) and (15.12) are 
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the discrete counterparts of the usual Fourier transform pair for 
continuous signals. A 
At present, discrete spectral analysis is one of the most widely Solve Problem 4 
used techniques of numerical analysis of signals on a computer. As 
an example, Appendix 5 gives a FORTRAN subroutine for 
computing the discrete Fourier transform. It should be noted that 
with a large number of sampled values, any direct calculation of the 
sum in (15.10) or (15.12) involves the expenditure of a lot of 
computer time. To avoid this, resort is widely made to what is 
called as the fast Fourier transform (FFT). By purely algorithmic 
means, it substantially reduces the amount of computations 
involved in finding coefficients for the discrete Fourier transform 
and the inverse discrete Fourier transform [35]. 
Discrete convolution. By analogy with the conventional 
convolution of two signals 


x 
d 
ft)- jx (x) y(t — x) dx The fast Fourier trans- 
| form (FFT) 


we may introduce a discrete convolution which is a signal 
represented by a collection of its sampled values 


N-—1 
fT Y um-bm-012..N-1 (15.13) 


k=0 


Let us establish the relation between the coefficients of the 
discrete convolution and the coefficients of the signals xg(t) and 
ya(t). To this end, we express the instantaneous values of the 
coefficients xy and y—, as the inverse discrete Fourier transforms 
of the corresponding spectra: 
N-I N=] 

xk= Y, Cynexp(j2nnk/N) Ym-k= Y, Cyexp [/2nl (m — k)/N] 
n=0 1=0 

and substitute them in (15.13): 


p N-IpN-I N-1 
Ín2— | Y Caneap jamin) |} X Cy 


N k=0 =0 1=0 


x exp [j 2x1 (m — ev] 


On changing the order of summation, we have 
1 N-1N-1 N-1 
Y È €aCyaexpG2xnlm/N)« Y, exp[j2x(n— Dk/N] 


= d 
N „Z0 120 k=0 


Ím 


(15.14) 
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Fig. 15.5 Signal reconstituted from discrete Fourier transform coefficients 


0.5 ^ 


where oj — argC; are the phase angles of the corresponding Fourier 
coefficients. As an example, Fig. 15.5 shows a signal x(t) 
reconstructed from its samples in accordance with the data given in 
Example 15.1. On the basis of Eq. (15.11) this signal may be 
defined as 


x(t)— - T Sos (2nt/T — 1/3) + Zos (6nt/T) 


It should be especially stressed that the reconstruction of 
a continuous waveform by Eq. (15.11) is not an approximate, but an 
exact operation fully equivalent to obtaining the instantaneous 
values of a band-limited signal from its samples making up the 
Kotelnikov series. In some cases, however, it is preferable to use the 
procedure based on the discrete Fourier transform, because it leads 
to finite sums of harmonics, while the Kotelnikov series for 
a periodic signal must in principle contain an infinite number of 
members. 

The inverse discrete Fourier transform (IDFT) The task of 
discrete spectral analysis may be stated in a different way. Suppose 
that the discrete Fourier coefficients C, are specified in advance. 
Also let us set t — kA in Eq. (15.8) and note that the sum is taken 
only over a finite number of members in the series, which 
correspond to the harmonics contained in the spectrum of the 
original waveform. Hence, we obtain an equation for sampled 
values 


N-1 
xk= Y, Cuexp(2nnk/N) (15.12) 


n=0 


which defines the algorithm of the inverse discrete Fourier transform 
(IDFT). 
The mutually complementing equations (15.10) and (15.12) are 
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the discrete counterparts of the usual Fourier transform pair for 
continuous signals. 

At present, discrete spectral analysis is one of the most widely 
used techniques of numerical analysis of signals on a computer. As 
an example, Appendix 5 gives a FORTRAN subroutine for 
computing the discrete Fourier transform. It should be noted that 
with a large number of sampled values, any direct calculation of the 
sum in (15.10) or (15.12) involves the expenditure of a lot of 
computer time. To avoid this, resort is widely made to what is 
called as the fast Fourier transform (FFT). By purely algorithmic 
means, it substantially reduces the amount of computations 
involved in finding coefficients for the discrete Fourier transform 
and the inverse discrete Fourier transform [35]. 

Discrete convolution. By analogy with the conventional 
convolution of two signals 

oo 


f(t)= f x()y(t— 9d: 


— 00 


we may introduce a discrete convolution which is a signal 
represented by a collection of its sampled values 


N-1 
fn = FY nip M=0, 1,2, 2. N-1 (15.13) 


k=0 


Let us establish the relation between the coefficients of the 
discrete convolution and the coefficients of the signals xg(t) and 
ya(t). To this end, we express the instantaneous values of the 
coefficients x, and y,, , as the inverse discrete Fourier transforms 
of the corresponding spectra: 


N-I N-1 
xk= > Cynexp(j2nnk/N)  Ym-k= }, Cyexp [/2nl(m — À)/N] 
n=0 120 
and substitute them in (15.13): 
1 N-irN-I a¢N-1 
fn=— X | Y, CaexpG2nnk/N) |} Y. Cy 
N KoL n=0 Jl 0 


x exp [j 2ni (m — el] 


On changing the order of summation, we have 
1 N-1N-1 N-—1 
Ín——— } Y CuCy expG2nlm/N)x Y. exp[2n(n — Dk/N] 


iV q-20 1=0 k=0 


(15.14) 
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It is easy to note that the inner sum 


N-I ‘ 
N, ifn=l 
exp[j2x(n— D) k/N] = ' 
2 Sip Dan - DENT lo i£ n3] 


k=0 
Here, the upper equality is obvious; the sum vanishes for nz 
because all terms are complex numbers of unity magnitude and 
with a linearly increasing argument. When they are combined 
vectorially, they always form a regular closed polygon on the 
complex plane. Taking advantage of the above result, we obtain on 
the basis of Eq. (15.14) 


N-I 
Ín Y, Cun Cyn exp (j2mmn/N) (15.15) 


n=0 


Since Eq. (15.15) is an inverse discrete Fourier transform, we may 
conclude that the Fourier coefficients of the convolution are the 
products of the discrete Fourier coefficients of the signals being 
convoluted: 


Cfk= CxkCyk, k=0, 1, ..., N—1 (15.16) 


Apart from establishing a useful analogy between the spectral 
properties of continuous and discrete signals, the above result is of 
importance for the theory of discrete signals and digital filters. The 
point is that if the number of sampled values is very large (say, 
several thousand), then, in finding the convolution of signals, one 
should first find their discrete Fourier transforms, then multiply the 
coefficients, and finally use Eq. (15.15) and the fast Fourier 
transform. This procedure is often more economical than the direct 
use of Eq. (15.13). 


15.3 The Theory of the z-Transform 


The z-transform is widely used in the analysis and synthesis of 
sampled-data systems. It has the same relationship to discrete (or, 
rather, sampled) signals as the integral Fourier and Laplace 
transformations bear to continuous signals. This section will set 
forth the basic theoretical aspects of the z-transform related to the 
properties of this functional transformation. 

Definition of the z-transform. Let {xk} —(xo, x;, x, ...) be 
a numerical sequence, finite or infinite, which contains the sampled 
values of a signal. We place this sequence in a one-to-one 
correspondence with a sum of an inverse power series of the 
complex variable z: 


e 
X (z) = xo + xi/z + xa/z? +... = Y xz" (15.17) 
k=9 
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This sum, if it exists, is called the z-transform of the sequence 
{xx}. The introduction of this mathematical concept is warranted 
because the properties of discrete sequences of numbers can 
conveniently be analysed by investigating their z-transforms with 
the usual techniques of mathematical analysis. 

On the basis of Eq. (15.17) we directly derive z-transforms for 
sampled signals with a finite number of sampled values. Thus the 
simplest sampled signal with a single sampled value, [xj] = 
— (1, 0, 0,...), corresponds to X(z) — 1. If, for example, [x4] = 
— (1, 1, 1, 0, 0, 0, ...), then 


X(z)=14 1/z + 1/2? = (z? + z + 1)/2? 


Convergence of the series. If the series defined in (15.17) contains 
an infinite number of members with nonzero coefficients, we should 
inquire into the convergence of the series. From the theory of 
functions of a complex variable [11] the following is known. Let 
the coefficients of the series in question satisfy the condition 


|xk| < MR$ (15.18) 


for any k 2 0. Here, M >0 and Rọ >Q are constant real numbers. 
Then the series (15.17) converges for any z such that |z | Rọ. In 
this region of convergence, the sum of the series is an analytic 
function of the variable z, having neither poles nor substantially 
singular points. 

As an example, consider a sampled signal [xij —(1, 1, 1, ...) 
formed by identical samples of value unity and serving as a model 
for the usual switching function. The infinite series 


X(z) 91 - l/z - 1/2 4 ... 


is the sum of a geometric progression and it converges for any 
z inside the domain |z | » 1. On taking the sum of the progression, 
we get 

X (z) = 1/1 — 1/z) - z/(z — 1) 


At the boundary of analyticity, this function has only one simple 
pole for z=1. 

Acting similarly, we derive the z-transform of an infinite sampled 
signal of the form 


Ux oU. d, n) 


where a is some real number. Then 





X (z)= 


—z/(z —a) 





with the series converging and with the expansion having any 
meaning only inside the domain |z | >a. 
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The z-transform of continuous functions.Assuming that {x,} are 
the sampled values of the continuous function x(t) at the sampling 
instants t = kA, we can assign to any signal x(t) its z-transform 
with a suitably selected sampling interval: 

X()= Y x(kAz * (15.19) 


k=0 


For example, if x(t) = exp(at), then the corresponding z-transform 
= Z 
X(z)= kA); =s —— — — 

(= Y apka = GA 
is an analytic function for |z |> exp(aA). 

The inverse z-transform. Let X (z) be a function of the complex 
variable z, analytic inside the circle |z|>R,. A distinction of the 
z-transform is that the function X(z) possessing this property 
defines all of the infinite set of sampled coefficients (xo, x,, X2, ...). 


To demonstrate, we multiply both sides of Eq. (15.17) by z" !: 


zu TX (exu 5 xz Ehe xar +... (15.20) 


then evaluate the integrals of the both sides of the above equality, 
choosing as the contour of integration a closed path wholly lying in 
the analyticity region and enclosing all the poles of the function 
X (z). In doing so, we take advantage of the fundamental fact 
stemming from Cauchy's theorem: 


feta = 2nj,  ifn=-—1 
"eid 0, ifn# —-1 
Then the integrals of all terms on the right-hand side, except the 
mth term, will vanish, and so 





-| Ọm-ı 15.21 
Xm 2 >. X (z) dz ( ) 





Equation (15.21) is known as the inverse z-transform. 





Example 15.2. Given: The z-transform 


X (2 —(z- yz 


To find: The coefficients of the sampled signal answering the above 


function. 


To begin with, we note that X (z) is analytic over the entire plane, 
except the point z — 0, and so there may exist a z-transform of 
some sampled (discrete) signal. 
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Referring to Eq. (15.21), we find that 
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X == dz = 1 
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1 
Xm ——Yz" 7 (z— 1)dz=0 
2nj 


for any m z 2. Thus, the sampled signal in question has the form (1, 
1, 0, 0, 0, ...). 








Relation to the Laplace and Fourier transforms. Let us define for 
t > 0 a sampled (discrete) signal in the form of an ideal pulse train: 
xa(t)= Y, xkõ(t— kA) 


k=0 
Its Laplace transform is 


F(p)= Y xkexp( — pkA) (15:22) 
k=0 


which directly goes into the z-transform if we set z = exp(p A). If, on 
the other hand, we put z=exp(j@A), the expression 


S(@) = 3 xy exp( — jokA) (15.23) 
k=0 


will be the Fourier transform of the pulse train. 
The relation we have just established plays an important role and 
permits us to draw certain analogies between the properties of 
continuous and discrete (sampled) signals. 
The most important properties of the z-transform. 
1. Linearity. If {x,} and {y,} are two numeric sequences 
representing some sampled signals whose z-transforms X(z) and The properties listed 
Y(z) are known, then the signal {ux} = {axk+ Byk} corresponds to here are directly ana- 
the transform U (z) = «X (z) + BY(z) for any constants c and B. This ogous to those of the 
is proved by substituting the sum in Eq. (15.17). Fourier and Laplace 
2. The z-transform of a time-shifted signal. Consider a sampled transforms of analog 
signal {yx} obtained by shifting {xx} backward by one position signals 
(one sampling interval) such that yy — xx..,. By directly evaluating 
the z-transform, we get 
9C oC 
Yiz)- Y xy ,z =z! Y xz "= 27 X(2) (15.24) 
k=0 


n=0 
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It is to be noted that z~‘ is the unit delay operator (a delay by one 
sampling interval) in the z-domain. 
3. The z-transform of a convolution. Let x(t) and y(t) be 
continuous signals for which the convolution function is 
oC x 


f(t)= f x(t)y(t—t)dt= f y(Ox(c— 9d: (15.25) 


By analogy with Eq. (15.25), for sampled signals we introduce 
a discrete convolution {fk} which is a series of numbers the 
common term of which is 

"e x 


Ín M Xkym-k= X vitae m=0, 1, 2... (15.26) 


k=0 k=0 


Let us take the z-transform of a discrete convolution: 


oC ac x 90 
Fe Y Xxx "= 3, Y xg y zr "P 
m=0k=0 m=0k=0 
aC x. 
= È ez * Yaz" = X (2) Y(2) (15.27) 
k= n= 


Thus, the convolution of two sampled signals corresponds to the 
product of their z-transforms. 


15.4 Digital Filters 


At present, communication signals are frequently processed with 
the aid of microcomputers and microcomputer systems. This 
section deals with the simplest and best known class of systems for 
digital signal processing known as linear stationary digital filters. 
Performing, similarly to analog circuits, the operation of frequency 
filtering, digital filters offer a number of important advantages. 
Among other things, this includes the high parameter stability and 
the choice of an extremely wide variety of shapes for the amplitude 
and phase responses. Digital filters need no alignment and tuning, 
and can readily be implemented in the form of computer algorithms 
and programs. 

The principle of digital signal processing. A basic block diagram 
for digital signal processing is shown in Fig. 15.6. 

A continuous input signal x(t) is fed to an analog-to-digital 
converter, ADC, controlled by sync pulses from a special generator 
which maintains the desired sampling rate. Each time a sync pulse 
is applied, the ADC delivers at its output a signal representing the 
instantaneous value of the input wave in the form of a binary 
number with a fixed number of digit (bit) positions. Depending on 
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Fig. 15.6 Block diagram of a set-up for digital processing of continuous 
signals 


Memory 





the particular arrangement of the digital filter, this number may 
correspond to a train of short pulses (when the transmission is in 
a sequential code) or to a set of voltage levels at the signal lines of 
the individual bit positions (when the transmission is in a parallel 
code). Thus transformed, the signal is fed to the main unit of the 
system, called the digital signal processor consisting of an arithmetic 
unit and a memory (or storage) unit. The arithmetic unit performs 
on numbers a range of operations such as multiplication, addition, 
and a time shift through a specified number of sampling intervals. 
The memory unit may store a number of previous sampled values 
of the input and output signals, which may be utilized in the course 
of signal processing. 

The digital processor handles the incoming numbers as 
prescribed by a filtering algorithm and produces at its output 
a sequence of binary numbers representing the output signal. If the 
end user needs data in analog form, the number sequence is 
additionally passed through a digital-to-analog converter, DAC. 
However, a digital filter may contain no DAC, if the output signal 
is only to be subjected to digital processing. 

The performance of a digital filter is judged in terms of its speed 
which depends on the rate of transients in the circuit components 
and on the complexity of the filtering algorithm. 

In the early 70s the frequency limit for the signals processed by 
digital filters was a few kilohertz. Advances in present-day 
microelectronics are continuously pushing back this limit. In recent 
time, digital signal filtering has been given a new momentum in its 
progress by the advent of relatively inexpensive and reliable 
microprocessors and memory units based on large-scale and 
very-large-scale integrated (LSI and VLSI) circuits. 

Signal quantization in digital filters. A distinction of any digital 
device is that signals are represented as numeric sequences with 
a limited number of digit positions. Therefore, the sampled signal is 
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quantized, that is, represented by a set of levels in such a way that 
the minimum difference between adjacent levels, or the quantization 
interval is equal to the 1 in the least significant bit position. 

The exact signal value in binary notation has the form: 


o0 
X= Yow2" (15.28) 
m=0 


where the coefficients o, are either zeros or ones. When the length 

of the number is limited to N digit positions, the exact value gives 

way to what is known as the rounded-off (or machine) value 
N-1 

x= Y a2 "«-gu2" (15.29) 


m=0 


where the coefficient By is equal to either xy or ay +1, according 
as the (N + 1)st bit position contains a zero or a one. 

In communication engineering, sampled signals represented by 
a countable set of levels or amplitudes are called amplitude- 
quantized or, simply, quantized signals. Signal quantization leads to 
a difference between the input signal and the quantized output. This 
difference is called the quantization noise. A straightforward path to 
minimize the quantization noise is to use multibit binary numbers. 
However, this inevitably reduces the speed of the digital filter 
because it takes more time to process multibit numbers. Therefore, 
practical microprocessors employed in sampled-data processing and 
sampled-data control systems ordinarily use binary numbers with 
4 to 16 bit positions. 

It may be added that quantization is also used in continuous- 
signal techniques, especially in various types of noise-immune pulse- 
modulated systems. 

The algorithm of linear digital filtering. The mathematical theory 
of digital filters carries over to the case of discrete signals all the 
basic considerations known from the theory of linear systems used 
to transform continuous signals. 

As will be recalled, a linear stationary system transforms 
a continuous input signal x (t) in such a way that its output delivers 
a wave y(t) equal to the convolution of x(t) and the impulse 
response h(t): 

oo 


y(0— f x(9h(t— rdt (15.30) 


A digital filter is a system (which may be a physical device or 
a computer program) which transforms a series, {xx}, of samples of 
the input signal into a series, {yx}, of samples of the output signal: 


(Xo, X4, X2, ..) => (Yos Vas Vas ---) (15.31) 
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or, in compact form, 


{xi} > (eh 

A linear digital filter is characterized by the fact that the sum of 
any number of input signals multiplied by arbitrary coefficients is 
transformed into the sum of its responses to the individual terms. 
That is, from the correspondences 


(X?) > OP} 9) = OP} 
it follows that 
o4 Q2) +... + ow (xk (o y +... + a yh} (15.32) 


for any coefficients à, à, ..., ON. 

So that Eq. (15.30) can be generalized to the discrete case, we 
introduce the concept of the impulse response for the digital filter. 
By definition, this is a discrete signal {hx} which is the response of 
the digital filter to a “unit impulse” (1, 0, 0, 0, ...): 


(1, 0, 0, 0, ...) (ho, hy, hy, ...) (15.33) 





A linear digital filter is stationary if the shift of the input unit 
impulse by any number of sampling intervals causes the impulse 
response to be shifted in a similar way, without any change in 
shape. For example: 


(0, 1, 0,0, ..) (0, ho, hy, hy ...). (15.34) 
(0, 0, 1, 0, ...)5 (0, 0, ho, hy, ha...) 


Let us see how the properties of linearity and stationarity lead to 
the most common algorithm for the digital filter in question. Let 
{xk} = (Xo. x4. X2, ...) be a signal applied to the input of the digital 
filter. The impulse response of the filter is known in advance. Using 
Eqs. (15.32) and (15.34), we may directly write the mth sampled 
value of the output signal {yk}: 





m 


Ym= Xohgm t X hg, +... + Xmho = » Xkħm-k (15.35) 


=0 





Fquation (15.35), which plays a leading role in the theory of 
linear digital filtering, tells us that the output series is the discrete 
convolution of the output signal and the impulse response of the 
filter. The meaning of the equation is simple and easy-to-visualize: 
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At each sampling instant, a digital filter performs the operation of 
the weighted summation of all previous values of the input signal, 
with the samples of the impulse response playing the role of the 
series of weighting coefficients. In other words, a digital filter has 
some sort of “memory” for the past inputs. 

Only physically realizable digital filters are of practical interest. 
For a physically realizable digital filter, its impulse response cannot 
be nonzero at the sampling instants preceding the instant when the 
input pulse is applied. Therefore, for physically realizable systems 
the coefficients h_,, h_,,... vanish, and the sum in (15.35) may be 
taken solely over all positive values of the index k: 
oC 

Xk hg ij, m=O, 1, 2, ... (15.36) 
-0 


Ym = 
E 


Discrete harmonic sequences. As will be recalled, complex signals 
of the form x(t) — Aexp[j(oet + ọ)], representing harmonic waves 
play a special role in the theory of linear systems. When such 
a signal is sampled, the result is a harmonic series or sequence 


(xi) = (ac ^tm) (15.37) 
such that 
Re {x} = {A cos (ok A+ q)] (15.38) 


It should be borne in mind that the sequences defined in (15.37) 
and (15.38) do not represent sampled harmonic signals in a unique 
manner. Indeed, these sequences will not change if we replace the 
frequency o with o + 2nn/A — o + nOs, where n is any integer and 
€, is the angular sampling frequency or rate. Therefore, we cannot 
in principle tell from one another two sampled harmonic waves if 
they differ in frequency by a whole-number multiple of the 
sampling rate. 

The frequency response of a digital filter. Suppose that the input 
of a linear stationary digital filter accepts a harmonic sequence {xx} 
such as defined in (15.37), which 1s unbounded in time, that is, with 
the index k capable of taking values 0, +1, +2,... . In order to 
find the output signal of the filter, {yg}, we take advantage of the 
convolution in (15.35) and determine the mth sample at the output: 


m m 


ym Y Xiin-k— ADE) Y 


k=- o% =- 0 


exp (j ak A) hs i 


On carrying out identity transformations, we get 


m 
ym — AAMA t y gio ma, c. 


k=- 
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Let us introduce a new summation index n=m—k. Then 


ym= Aci9nA*9 y e Jandy, (15.39) 
n=0 
As follows from Eq. (15.39), the output signal has the structure of 
a discrete harmonic sequence of the same frequency as the input 
signal. The output samples are derived from the input samples by 
multiplying the latter by the complex number 


K (jo) = y exp( — jeonA) hn (15.40) 


n=0 


called the frequency response of the digital filter. It depends on the 
frequency o of the input signal, the sampling interval A, and the set 
of coefficients, {h,}, of the impulse response of the digital filter. 
From Eq. (15.40) we may draw the following important conclusions: 

1. The frequency response of a digital filter is a periodic 
frequency function with a period equal to the sampling rate @s= 
= 21/A. 

2. The function K(j@) may be treated as the Fourier transform 
of the impulse response of a digital filter, represented by a series of 
delta impulses: 


ha(t) =h)d(t) - h,6(t — A) - ... 


(Compare with Eq. (15.23).) 

The system function of a digital filter. The frequency response of 
a digital filter can conveniently be found using the techniques of the 
z-transformation. 

Given the three sequences of discrete signals (xj), (yx) and {hy}, 
their z-transforms will be X (z), Y(z) and H (z), respectively. The out- 
put signal of a digital filter, {yx}, is the convolution of the input 
signal and the impulse response, so [see Eqs. (15.27) and (15.35)], 
the function corresponding to the output signal is 


Y(z) = H (z) X (z) (15.41) 

The ratio of the z-transform of the output signal to the 
z-transform of the input signal is called the system function of 
a stationary linear digital filter. From Eq. (15.41) we find that the 
system function of such a filter, defined by 


H(z) = ¥(2)/X(z)= Y hz^* (15.42) 
k=0 





is the z-transform of its impulse response. 
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Comparing Eqs. (15.40) and (15.42), we can draw the follow- 
ing conclusion: The frequency response of a digital filter 
can be deduced by inserting z = exp(jwA) in its system function. 











Example 15.3. Consider a digital filter whose impulse response 
consists of two nonzero samples: (hy) — (1, — 1, 0, 0, 0, ...) and find 
its frequency response K (jo). 

Here, the system function is 


A(z)=1=2 1 

Hence, 

K (jo) = 1 — exp( — joA) = (1 — cos oA) + j sin oA 
= | K (jo) | exp [j ex (@)] 


The amplitude response of the filter takes the form 





IK (jo) |=) — cos wA)? + sin? oA = 2 sin 9 | 


and its phase response is 


sin oA 


OK (œ) = arctan qT = cost. 


The amplitude and phase characteristics of the filter are periodic 
functions of frequency, but practically they are meaningful only in 
the interval from 0 to o = n/A. At the upper frequency limit of this 
interval, two samples correspond to each period of the sampled 
harmonic signal. By the Kotelnikov sampling theorem, this is the 
highest frequency of the signal that can be uniquely recovered from 
its samples. 

It is to be noted that if the input to such a filter is a harmonic 
signal at a frequency substantially below the sampling rate such 


that oA«1, then 
(0A) . (wA)? 
—. ^— ES 
E ]e [o 6 + 








Kyo) -13 


Jj 
Therefore, the system in question performs the operation of 
approximate differentiation with respect to the slow input signals. 
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15.5 Implementation 
of Digital Filtering Algorithms 


In order to form the output signal corresponding to the ith 
sampling instant, physically realizable filters operating in real time 
may use the following initial specifications: (a) the value of the 
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input signal at the ith sampling instant and also a number of “past” 
input samples x; ,, Xj. 3,.... Xi m; (b) several past samples of the 
output signal, y;_,, yj: 2,..., Vi-n- The integers m and n define the 
order of a digital filter. 

According to the manner in which information about the past 
states of the system is utilized, digital filters can be classed into 
several types. 

Transversal digital filters. This term refers to digital systems 
which operate by the following algorithm: 


Ji agXi  d4Xj., t d3Xj-5 + ... + dmXi-m (15.43) 


where ao, 41, ..., dm are a series of coefficients. The number m is the 
order of the transversal filter. As is seen from Eq. (15.43), 
a transversal filter carries out the weighted summation of the 
previous samples of the input signal and does not use any previous 
samples of the output signal. By taking the z-transforms of both 
sides of Eq. (15.43), we see that 

Y(z)-(ag--aiz ! +4327 ? +... +amz~™) X (z) 

Hence, the system function of the filter 

H(z2-—ag-a,z c az ^... + amz 


m 


aoz” az" ^! + az" 7 +... +a 
=f Te 2 m (15.44) 
z 





is a rational function of z, which has m-tiple pole for z= 0 
and m zeros whose coordinates are defined by the coefficients of 
the filter. 

The algorithm by which a transversal digital filter operates 
is illustrated by the block diagram of Fig. 15.7. The basic building 
blocks of the filter are the delay units, z^ !, which delay the samples 
for one sampling interval, and also the scalers which multiply by 
the corresponding coefficients in digital form. From the scalers, the 
signals are routed to an adder where they are combined to yield the 
sampled value of the signal. 

From the structure of the block diagram, it is clear why 
this filter is called transversal. 

Program (software) implementation of a transversal filter. ]t 
should be borne in mind that the block diagram appearing 
in Fig. 15.7 is not a kind of schematic diagram for some electric 
network, but only a graphical representation of the algorithm for 
signal processing. As an example, consider a fragment of 
a FORTRAN routine implementing transversal digital filtering. 

Let the internal computer memory contain two one-dimensional 
arrays of M locations each. One array, X, contains the values of the 
input signal; the other array, A, holds the coefficients of the filter. 
The data in the arrays are disposed in the following manner. 
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Fig. 15.7 Block diagram of a transversal digital filter 


Array A holds constants, whereas the contents of the locations in 
array X change each time a new sampled value of the input signal 
is received. Suppose that array X is filled full with the previous 
sampled values of the input series and consider the situation arising 
when there arrives the next sampled value which the program has 
named the variable S. This sampled value must be stored in 
location 1, and this can happen only after the previous record has 
been shifted one position to the right, that is, backward. 

The elements of array X thus formed are multiplied one by one 
by the elements of array A, and the result is stored in location 
Y which accumulates the sampled value of the output signal. The 
routine for transversal digital filtering is given below: 


DOI K=1, M-1 
1 X(M-K-41)-X(M - K) 


X()-S 

C ARRAY X IS FORMED 
Y=0 
DO2 K=1,M 


2 Y=Y+X(K)*A(K) 


The impulse response. Let us go back to Eq. (15.44) and find the 
impulse response for a transversal digital filter by taking the inverse 
z-transform. It is easy to see that each term of the system function 
H(z) is responsible for a contribution which is equal to the 
corresponding coefficient a; shifted j bits backward. Thus, here 


{hy} = (a, ay; a), vers am) (15.45) 


This result can be obtained directly by inspection of the block 
diagram of the filter in Fig. 15.7, assuming that it is driven by 
a unit pulse (1, 0, 0, 0, ...). 

It is important to note that the impulse response of a transversal 
filter contains a finite number of members. 
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The frequency response. By a change of variable, z = exp (joA) in 


Eg. (15.44), we get 


K (je) = ay -- ae 74 + ae 7 ™ +... + age i (15.46) 


With any specified sampling interval A, we can obtain a fairly 
wide variety of amplitude and phase characteristics by choosing 
appropriate weighting coefficients for the filter. 


This type of filter 
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Example 15.4. Investigate a second-order transversal digital filter 
which takes the average of the present value of the input signal and of 
its two previous samples: 


yi- ios + Xi-1 Xi-2) (1547) 
The system function of the filter is 

H()- à *tz7ixz 2) 

Hence, the frequency response of the filter is 


K (jo) = 5(1 te 79^ + 71204) 


1 
Tu [(1 + cos oA + cos 20A) — j (sin wA + sin 2@A)] 


Simple manipulations lead to the following expression for the 
amplitude response: 





1 
K (jo) |= —//3 + 4 cos wA + 2 cos 20A (15.48) 
3 


and for the phase response of the system: 


sin wÅ + sin 20A 


1 + cos œA + cos 20A — — QA (15.49) 


Ox (®) = — arctan 
Their plots appear in Fig. 15.8 where the phase angle, œA, of the 
sampling interval for a given value of frequency is laid off as 
abscissa. 

Suppose that œA = 60°, which means that six samples are taken 
over each period of the harmonic input wave. Then the input 
sequence will have, say, the following pattern 


.., 0, 1, 1,0, —1, —1, 0, t, 1, .. 

(the absolute values of samples are immaterial, because the filter is 

linear). Using the algorithm in (15.47), we find the output sequence: 
2.82 2 2 


— — Ü cus 
3° 3° > 
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0 90 180 270 360 wA,deg 





-90 
180 
-270 
—360 
0 60 120 180 240 300 9 
k,deg 
(a) (b) 


Fig. 15.8 Characteristics of the transversal digital filter examined in 
Example 15.4: (a) amplitude response; (b) phase response 


As is seen, it corresponds to a harmonic output signal of the 
same frequency as the input signal, but with an amplitude which is 
2/3 =0.66 the amplitude of the input wave, and with the initial 
phase shifted by 60° lagging. 

If oA < 120°, the filter could act as a low-pass filter since it 
smoothes the input sequence. However, its frequency response is 
periodic and nonmonotonic. If the original analog signal has not 
been subjected to preliminary frequency filtering and contains 
components for which œA > 180° (so that the requirement of the 
Kotelnikov sampling theorem is not satisfied), they will not be 
attenuated by the digital filter in question. In fact, from the samples 
of these high-frequency components the digital-to-analog converter 
would reconstruct some low-frequency wave not present in the 
input signal. This undesirable event (the effect of superposition or 
masking by the high-frequency components of the spectrum) is in 
principle inherent in any digital system and makes mandatory the 
preliminary processing of signals which are to be subjected to 
digital filtering. 
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Recursive digital filters. A distinction of this type of digital filter 
is that the ith sample is formed using the previous values of both 


the input and output sequences: 


Yi = AgXj + diXi ic... + AmX —m + biyi- 1 tbc asg + bnYi-n 


(15.50) 


where the coefficients b,, b2, ..., bn defining the recursive part of the 
filtering algorithm are not equal to zero simultaneously. To stress 
the difference in structure, it is usual to call transversal digital filters 


nonrecursive. 


The system function of a recursive digital filter. On taking the 
z-transforms of both parts of the recursion relation (15.50), we find 
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that the system function 
Ag tayz i+... +anz 
I—b,z!-..—b,z ^" 


m 





H(z- Y(z)/X(z)= 


_ ag” $4,271 +... + amz” 
z bz... bn (15.51) 





describing the frequency behaviour of a recursive digital filter has 
n poles in the z-plane. If the coefficients of the recursive part are 
real, the poles either lie on the real axis or form complex-conjugate 
pairs. 

The block diagram of a recursive digital filter. In block-diagram 
form, the algorithm answering Eq. (15.50) appears in Fig. 15.9. As 
is seen, the top part of the block diagram corresponds to the 





Fig. 15.10 Canonic 2nd-order recursive filter 
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transversal (nonrecursive) part of the filtering algorithm. In the 
general case, its implementation calls for m+1_ scaling 
(multiplication) blocks and m memory cells to store the input 
samples. 

The recursive part of the algorithm provides for the use of 
n consecutive values of the output signal, which are shifted from 
location to location during the operation of the filter. 

A disadvantage of the above realization principle is that it calls 
for a large number of memory cells, separately for the recursive and 
the nonrecursive parts. A far better choice is offered by canonic 
recursive digital filters which use the least possible number of 
memory cells equal to the largest of the numbers m and n. As an 
example, Fig. 15.10 shows the block diagram of a 2nd-order 
canonical filter for which the system function has the form 


(15.52) 


To make sure that the system in question realizes the specified 
function, consider an auxiliary digital signal {wx} at the output of 
adder 1, and write two obvious equations: 


Wk = Xk + bywe_ , + b3wy (15.53) 
Vk = dgWk + d4Wk 4 T 45Wk (15.54) 


On taking the z-transform of Eq. (15.53), we get 
X (z) 

1—bz !—byz ? 

By virtue of Eq. (15.54), however, 

Y(z2 = (a az ! - az ?)W(z) (15.56) 


On combining (15.55) and (15.56), we arrive at the specified system 
function in (15.52). 

The stability of recursive digital filters. À recursive digital filter is 
a discrete counterpart of a dynamic system, because its memory 
elements store information about its previous states. Therefore, if 
we specify some initial conditions, that is, a set of values (yj. ,, 
Ji-2 «+» Yi-n), the filter will cyclically form the elements of an 
infinite sequence (yi, yj+,, ...) Which acts as the free oscillations 
(transient response) at the output. 

A recursive digital filter is called stable, if the free (transient) 
process occurring within it is a nonincreasing sequence, that is, if, 
with n tending to infinity, {y,,} does not exceed some preset positive 
number M, irrespective of the choice of initial conditions. 

On the basis of Eq. (15.50), free oscillations in a recursive digital 
filter must be the solution of the following linear difference 


W(z)= (15.55) 
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equation: 
yi = dyyj- + bayj-2 + «+ On Vi-n (15.57) 


By analogy with linear differential equations, we will seek the 
solution of Eq. (15.57) in the form of an exponential function 


yi= a (15.58) 


in which « is as yet unknown. On substituting (15.58) into (15.57) 
and cancelling out the common factor, we find that « must be 
a root of the characteristic equation 


a" — buo"! — ba? —... — b, =0 (15.59) 


which, on the basis of (15.51) fully checks with the equation 
satisfied by the poles of the system function of a recursive digital 
filter. 

Suppose we have found all the roots o, a, ..., &, of Eq. (15.59). 
The general solution of the difference equation (15.57) has the form 


yi= Aoi + Anat +... + Ad, (15.60) 





in which the coefficients A,, A, ..., 4, must be matched so as to 
satisfy the initial conditions. 

It can be noted that if no one of the poles of the system function 
H(z), that is, the numbers z; =, ..., Zn = Œn, exceeds unity and 
therefore they all lie inside the unit circle with centre at z = 0, then, 
by virtue of (15.60), any free (transient) process in a digital filter will 
be described by the members of a converging geometric 
progression, and the filter will be stable. 


Clearly, only stable digital filters can be used practically. 
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H(z= i 


has the roots 


b ee 
Z127 3$ Vo, y + b, 


The curve described by the equation b? + 4b, =0 on the (b,, b,) 
plane is the boundary above which the poles of the system function 
are real, and below which they are complex conjugate. 


For complex conjugate poles, 


lz1.21 = =b, 
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Therefore, one of the stability boundaries is the straight line b, = 
= — [. If we consider real poles for b, 0, the condition of 
stability will have the form 


b,/2 V (b /2 + b; «1 

OT 

Vb, /2)? b, «1— 5,72 

By squaring both sides of the above inequality, we can see that the 


stability region is bounded by the straight line b, = 1 — b,. The case 
when b, <0 can be analysed similarly. 





Fig. 15.11 Stability region for a 2nd-order recursive filter. (The filter poles 
are complex conjugate inside the coloured area.) 


To sum up, the recursive filter in question is stable if the values 
of the coefficients b, and b, are located inside the triangle shown in 
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Fig. 15.11. 





A 
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The impulse response of a recursive digital filter. A distinction of 
a recursive digital filter is that it contains feedback loops. In 
consequence, the impulse response of a recursive digital filter is 
described by an unbounded time sequence. We will demonstrate the 
statement by reference to an elementary l1st-order filter whose 
system function is 
H(Q)=—— fz — b) 

= ÃĀ— Ssh — Z. — 

A= het on 
The filter is stable, if |b] <1. 

As will be recalled (see Eq. (15.42)), the impulse response is found 
by taking the inverse z-transform of the system function. Using 
Eq. (15.21), we find the mth member in the sequence (hi): 


ha I jore: 
lm = 2nj Ib (15.61) 


2 


The integration is carried out around the unit circle inside which 
the pole z 2 b is located. 
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Since, as can be readily seen, the residue of the integrand at the 
pole is equal to ab", the sought impulse response of the filter is 
a decreasing geometric progression 


{hy} — (a, ab, ab?, ...) (15.62) 


15.6 Synthesis of Linear Digital Filters 


Currently, special emphasis in the synthesis of digital filter struc- 
tures is placed on the techniques and procedures assuring some 
desired properties which may be a particular shape of the impulse 
or frequency response [35]. In the pages that follow we will be 
mainly concerned with synthesis procedures which substantially 
draw on the properties of the analog circuits that serve as 
prototypes for the digital filters being synthesized. 

Ordinarily, a digital filter is synthesized with the aid of 
a computer. The number of significant digits in the final results 
must be sufficient for the desired accuracy to be achieved. 
Obviously, the filter must be stable in any case. 

The invariant impulse response method. This is the simplest 
method for digital filter synthesis. It is based on the assumption 
that the impulse response of the filter being synthesized must be the 
same as will be produced by digitizing the impulse response of the 
corresponding analog prototype. Bearing in mind that we are 
concerned with the synthesis of physically realizable systems for 
which the impulse response is zero at t < 0, we obtain the following 
expression for the impulse response of a digital filter 


[uj = (h), h(A, hQA) ..) . (15.63) 


The number of samples in the impulse response sequence of 
a digital filter may be finite or infinite. Accordingly the structure of 
the filter will be different: An impulse response with a finite number 
of samples corresponds to a transversal filter; an impulse response 
with an infinite number of samples corresponds to a recursive filter. 

The relation between the coefficients of the impulse response and 
the structure of a digital filter is especially simple in the case of 
a transversal filter. In the general case, the search for the desired 
structure is begun by taking the z-transform of the sequence in 
(15.63). Once the system function H (z) of the filter is obtained, the 
next step is to compare it with the general expression (15.51) and to 
determine the coefficients of the transversal and recursive parts of 
the filter. 

The degree of approximation between the frequency characteristic 
of the digital filter being synthesized and that of the analog 
prototype depends on the choice of the sampling interval A. If 
necessary, the frequency response of the digital filter can be found 
by a change of variable, z = exp(joA), in the system function H(z), 
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and by comparing the result thus obtained with the known fre- 


quency response of the analog network. 








Example 15.6. Go through the synthesis of a transversal digital 
filter similar to a Ist-order dynamic system (say, an integrating 
RC-network) whose impulse response has the form 


0, t«0 
s) -i exp(—t/t), t»0 poo 


(The amplitude coefficient in the impulse response is set equal to 

unity, as it is of minor importance to the synthesis procedure.) 
Suppose that the impulse response is approximated by 

a sequence of three equidistant samples: 

{hy =(1,e 7 e72^n) (15.65) 


The transversal digital filter having this form of impulse response is 
described by the following difference equation: 


My, ate Aa a (15.66) 


By taking the z-transform of the sequence in (15.65), we obtain 
the system function of the digital filter: 


yk=xk+e 


H(z =1+e7 z^! 4 e 227-2 (15.67) 
Hence, the frequency response is 
K (jo) 9 1 - e^ Ne 95 4 o7 281,204 (15.68) 


Example 15.7. Consider the case where the impulse response 
(15.64) of an analog network is approximated by the infinite discrete 
sequence 


{hg = (1,6787 e7234...) (15.69) 


By taking the z-transform of the impulse response in (15.69), we 
obtain the system function 


H(z =1 +e Mizuno, 
zd ege "2-4 (15.70) 


This system function defines a 1st-order recursive digital filter 
which contains an adder, a scaler, and a delay unit. 
The frequency response of the synthesized filter is 

1 


K (jo) = (15.71) 








Comparison of transversal and recursive digital filters. It is fre- 
quently required that the frequency characteristic of a digital filter 
being synthesized should approximate that of the analog prototype 
with sufficient accuracy. The choice of a particular filter structure 
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within the framework of the invariant impulse response method has 
a marked effect on the accuracy of approximation. 

Let us compare the frequency characteristics of the two digital 
filters examined in Examples 15.6 and 15.7. Both correspond to an 
analog prototype whose frequency response is 


K (jo) = 1/(1 + jor) (15.72) 


On putting t/A — 5 to make the matters more specific and on 
carrying out simple manipulations on the basis of Eqs. (15.72), 
(15.68) and (15.71), we can write the following expressions for the 
normalized amplitude response of the analog filter and of the two 
digital filters, recursive and transversal 




















1 

a j "mE (15.73) 
= Fc = (15.74) 
K(j9) |r |/1.6703 — 1.6375 cos oA 

KUo)| 1/2120 + 2.7351 cos wA + 1.3406 cos 20A 

KUO) X 7 2.48903 eo) 





The values of | K (j@)/K (j0) |, as found from the above equations, 
are summarized in Table 15-1. 


Table 15-1 
Filter type 

oA 

analog a digital digital 

recursive transversal 

0.0 1.0000 1.0000 1.0000 
0.5 0.3714 0.3754 0.9200 
1.0 0.1961 0.2046 0.7005 
1.5 0.1322 0.1454 0.3963 
2.0 0.0995 0.1182 0.1305 
2.5 0.0797 0.1050 0.2234 
3.0 0.0665 0.1000 0.3360 


As is seen, both the recursive and the transversal digital filter has 
the frequency characteristics of a low-pass filter. However, the 
recursive filter is closer in properties to the analog prototype than 
the transversal filter. 

Digital filter synthesis by digitization of the differential equation 
of the analog prototype. A digital filter structure approximately 
corresponding to a known analog network can be derived by 
digitizing the differential equation which describes the analog 
prototype. As an example of the procedure, we will go through the 
synthesis of a digital filter similar to a 2nd-order dynamic system 
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for which the relation between the output wave y(t) and the input 
signal x(t) is established by the differential equation 


d?y/dt? + 2ady/dt + oy = x (t) (15.76) 


Suppose that the sampling interval is A, and consider two sets of 
samples, {yg} and {xx}. If in Eq. (15.76) we replace the derivatives 
with their finite-difference expressions, the differential equation will 


turn into a difference equation 
yn — 2y -1 t y -2 yn — y -1 2 
: FS de ^ EE OYn = Xn (15.77) 





On re-grouping, we get 
A?xn + 2(1 + 4A) yai — Ya-2 
yu———————————.———— 
A 
where A = 1 — 22A + @A?. 

The difference equation (15.78) defines the algorithm for the 
2nd-order recursive filter which models an analog oscillatory 
system. This form of digital filter is called a digital resonator. If the 
coefficients have been properly chosen, a digital resonator can 
operate as a frequency-selective bandpass filter similar to a resonant 
(tuned) circuit. 

The invariant frequency characteristic method. There are basic 
reasons why it is impossible to build a digital filter whose frequency 
behaviour would exactly replicate that of some analog network. 
One reason is that the frequency response of a digital filter is, as 
will be recalled, a periodic function of frequency with a period 
decided by the sampling interval A (Fig. 15.12). 

As regards the similarity between (or the invariance of) the fre- 
quency behaviour of an analog and a digital filter, we may only 


(15.78) 


IKI 


(a) 


Wa 





Wd 


-2R/A -R/A 0 RA 2n/A 





Fig. 15.12 Comparison of amplitude responses: (a) analog filter; (b) digital 
filter 


Ch. 15 Principles of Digital Filtering 


require that all of the infinite frequency interval oa associated with 
the analog system be transformed into the frequency interval oq 
associated with the digital filter, such that 


— T/A < @dq < T/A (15.79) 


with the amplitude response retaining its general shape. 

Let Ka(p) be the transfer function of an analog filter, specified by 
a rational function in powers of the complex frequency p. Taking 
advantage of the fact that z=exp(pA), we may write 
p=(1/A)Inz (15.80) 
From this relation, however, we cannot deduce a physically 
realizable system function for the digital filter, because the substi- 
tution of (15.80) into the expression for K,(p) would result in 
a system function which is not the quotient of two polynomials. It 
is required to find a rational function of z which would possess the 
basic property of the transform (15.80), that is, which would map 
points on the unit circle in the z-plane into points on the jo-axis in 
the p-plane. 

Among the various procedures, the following relation is widely 
used [35] 





p = Q/A)(z — 1y( + 1) (15.81) 


which establishes a one-to-one correspondence between points on 
the unit circle in the z-plane and the entire imaginary axis in the 
p-plane. À salient feature of this form of mapping is as follows. By 
a change of variable, z = exp (jos), in (15.81), we get 


_ 2 aplod- 1 
— A exp(josA) 4- 1 


Hence, the following relation between the frequency variables 64 
and @, of the analog and the digital system respectively, emerges: 


a 





Oa — Z tan (@sA/2) (15.82) 





If the angular sampling rate is sufficiently high (w,A « 1), then, as 
can be readily seen from Eq. (15.82), o4 x: 6, Thus at low fre- 
quencies the characteristics of an analog filter and of a digital filter 
are about the same. In the general case, one should consider the 
scale transformation along the frequency axis of the digital filter 
described by Eq. (15.82). 

Practically, the synthesis of a digital filter consists in that the 
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variable in the function K,(p) is changed in accord with Eq. (15.81). 
The system function thus obtained is a rational function, so the 
digital filtering algorithm may be written directly. 





Example 15.8. Synthesize a digital filter whose frequency behaviour 
is similar to that of a 2nd-order Butterworth analog low-pass filter. 
The cut-off frequency for the digital filter must be oca- 1500 s^ +. 
The sampling rate is à, — 10000 s ^ !. 

To begin with, we find the sampling interval 
A = 2n/a, = 6.2832 x 107 ^s 
By Eq. (15.82), the cut-off frequency of the Butterworth analog filter 
similar to the digital filter being synthesized is 

2 Oc q^ 
Oca = — tan —— = 1621.9 s^! 
" A 2 


As will be recalled, the transfer function of a 2nd-order 
Butterworth analog filter, written in terms of the normalized 
complex frequency pw, has the form (see Chap. 13) 


Ka(pN) = — —Á (15.83) 
pat V2 py + 1 
or, changing back to the true complex frequency, 
Qa 
Ka(p)= 2 =— 2 
p“ + V20ca D+ Wea 


By a change of variable in (15.84) in accord with Eq. (15.81), the 
system function of the digital filter is 


Géa(z F ie 


cae z + 2 |2242 2 2 ? 
A V 20c,a A PPA z 2| Oca A 


2\? 2 
+ (3) E VA (4) Oca + Oca 


On substituting the numerical values in the above expression, we 
get 


(15.84) 








H(z)= 








(15.85) 


z?+2z+1 
7.627227 — 5.7033z + 2.0761 





H(z)= (15.86) 





The effect of quantization on the performance of a digital filter. 
In the synthesis and design of digital filters it is important in some 
cases to consider the specific errors arising from signal quantization 
by which all quantities, both constant and time-varying, are turned 
into binary numbers of a finite length. 
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Quantization results in a fairly wide range of effects. They are all 
examined in the literature on digital filtering [35]. Here we will be 
concerned with the quantization (or quantizing) noise, the simplest 
effect of all. 

Let Vmax be the maximum value of the analog signal applied to 
the input of the analog-to-digital converter of a digital filter, which 
does not yet cause an overflow in the arithmetic units of the filter. 
If m is the number of bits (word length) allocated to represent the 
input signal in the filter, it is then obvious that the input signal will 
be quantized into levels spaced apart by a quantization step of size 


do = Vinax/2” (15.87) 


The quantized levels represent the true instantaneous values of an 
analog signal accurate to what is known as the quantizing error 
which decreases as the step size, or the spacing between the 
quantizing levels, is reduced. So the quantized representation of the 
input signal, xy, may be visualized as the sum of the true values X, 
and the errors ny which constitute the quantization noise 


Xk— Xk+ nk (15.88) 


As theoretical and experimental studies have shown, in most 
cases of practical interest the error sequence {n} is made up of 
statistically independent random variables each of which is 
uniformly distributed in the interval from — q9/2 to do/2. and so 
the error sequence has zero mean and its variance is 62, — = q$/12 
(see Chap. 6). 

The quantization noise present at the input of a digital filter is 
processed in the same manner as the valid signal. Let {ninx} be the 
discrete sequence representing the input quantization noise. In 
order to find the Ith sample in the output noise sequence {noutx}, 
we should evaluate the convolution of the input quantization noise 
with the impulse response of the filter 


nout, = y hinin, i—i (15.89) 


i=0 
Hence the autocorrelation function of the output quantization noise 
is 


Kou (m) = » Aout,i out —m 
i20 


® x 
= Y X. hjnini-— -j hj- mlini—j—m 
i=Oj=0 


in(m) ^ hjhj-m (15.90) 
j=0 
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On setting m — 0, the variance of the output noise is found to be 


oo > 


l l 2 oo 
Solve Problem 15 do vi (15.91) 


Sout = Kom (0) = Kin (0) È n E 12 
j-0 e g— 








As is seen, the output quantization noise increases as the roll-off of 
the impulse response of the filter slows down. 
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In contrast to analog signals, discrete (sampled) signals are represented by sequences 
of samples at a discrete set of points. 

The spectrum of a discrete signal consists of an infinite number of repetitions of the 
spectrum of the original analog signal. 

The reconstruction of the original signal from a discrete sequence of samples by a real 
frequency filter inevitably introduces signal distortion. 

The number of amplitude harmonic coefficients that can be found with the aid of the 
discrete Fourier transform is half the number of samples. 

The z-transform permits discrete sequences to be investigated by the techniques of 
mathematical analysis applicable to continuous functions. 

The output sequence of a digital filter is the discrete convolution of the input signal 
and the impulse response of the filter. 

The frequency response of a digital filter is the Fourier transform of its impulse 
response and is a periodic function of frequency with a period equal to the sampling 
frequency (rate). 

The system function of a digital filter is the z-transform of its impulse response. 
According as the filtering algorithm is realized, digital filters are customarily classed 
into transversal or recursive. 

A recursive digital filter is stable if all the poles of its system function are located 
inside the unit circle with centre at z=0. 

In the synthesis of digital filters, it is convenient to use the impulse or frequency 
response of an analog prototype filter. 

The representation of quantized data as binary numbers of finite length leads to 
a specific source of error in the operation of digital filters, called the quantization 
noise. 


Review Questions 


1. Draw a block diagram for a pulse modulator. What is the difference between PAM and 
PWM signals? 


w N 


. What is the spectrum of the sampling sequence? 
. What is the cause of the distortion in the signal appearing at the output of 


a reconstructing low-pass filter, if its cut-off frequency is substantially higher than the 
frequency (rate) at which the input pulse sequence is sampled? 
4. Over its periodicity interval a sampled signal is specified by 16 samples. What is the hi- 
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ghest harmonic that can be found from these data with the aid of the discrete Fourier 
transform? 


. Formulate the conditions of convergence for the z-transform. 
. If the z-transform of a numeric sequence is known, how can the Fourier or Laplace 


transform of the corresponding discrete signal be found? 


. What is the number of bit positions (word length) ordinarily used in digital filters to 


represent sampled waveforms? 


. List the properties of the impulse response of a stationary linear digital filter. Define the 


condition that the impulse response of a physically realizable digital filter should satisfy. 


. Why is it that the representation of harmonic analog signals with a sequence of 


equidistant samples does not give a unique result? 


Define the concept of the system function of a digital filter. 


11. What are the differences between the system functions of transversal and recursive 


digital filters? 


12. What is the basic difference between the impulse responses of transversal and recursive 


digital filters? 


method? 


. Name the advantages of the canonic form of digital filters. 
. What is the rationale of digital filter synthesis by the invariant impulse response 


15. Why is it impossible to synthesize a digital filter whose frequency behaviour precisely 
replicates that of the analog prototype filter? 


output quantization noise? 


Problems 


1. An analog signal x(t) is a rectangular 
video pulse of duration tp=2 ms. Its 
sampled version is a discrete pulse sequence 
(a PAM signal) consisting of ten equidistant 
video pulses each of 5 us duration. Find the 
spectrum of the pulse sequence. 

2. Over its periodicity interval a discrete 
signal is specified by four equidistant 
samples: {x} — (1, 0, —1, 0). Find the 
discrete Fourier transform coefficients of the 
signal. 

3. Derive the equation describing the 
analog signal x(t) reconstructed from the 
discrete Fourier transform coefficients of 
Problem 2. 

4. A periodic discrete signal has the 
following harmonic amplitude coefficients: 
C,=0.5, C,=1.5 (the coefficients of the 
higher harmonics are zero). Find the sample 
values of the signal. 


. How does the shape of the impulse response of a digital filter affect the variance of the 


5. A sampled signal {xx} is specified by 
four samples. Find the z-transform of the 
signal: 


-2 


6. Find the z-transform corresponding to 
an analog signal x(t) — at(t — 0), where a is 
a constant. 

7. Let the z-transform of a discrete signal 
{xk} have the form 


z? +2z+1 
X (z) = —————— 


Find the samples of the discrete signal. 
8. The impulse response of a digital filter 
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is specified by three nonzero samples: 
[Ahi] = (1, 0.5, 0.25). Find the system function 
and the frequency response of the digital 
filter. 

9. Draw a block diagram of the digital 
filter realizing the following algorithm: 


yi = 1.75x; — 0.55xj.., + 0.25x;_ 5 


Find the system function. 
10. A recursive digital filter realizes the 
following algorithm: 


yi ^ xi + O.5y;_, —0.75y;_, 


Analyse the digital filter for stability. 

11. Calculate and plot the impulse 
responses of the digital filters described by 
the following difference equations: 


(a) yi= 2.5xi - 08y;-, 
(b) y; = 2.5x;+ O.8y;. , 


12. Using the invariant impulse response 
method, synthesize a transversal digital filter 
similar to an integrating RC network. The 
impulse response of the digital filter is 
specified by four equidistant samples. 
Calculate the frequency response of the 
synthesized filter on setting A/t = 0.5. 

13. Using the invariant frequency 
response method, synthesize a digital filter 
whose frequency response is similar to that 
of a 2nd-order Chebyshev analog filter with 
Oca=2x10%s ! and ec=08. The 
sampling frequency (rate) is @s= 1.5 x 
x 10*s-*. 

14. The analog signal at the input of an 
analog-to-digital converter has a maximum 
amplitude Vm=50 V. The samples are 
represented by eight-digit binary numbers. 
Calculate the variance of the quantization 
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noise at the output of the analog-to-digital 
converter. 

15. There is a recursive digital filter 
whose algorithm is y;=0.45x;+ 0.95y; ,. 
The quantization noise at its input is 
quantized into levels spaced gg=0.5 mV 
apart. Find the variance of the quantization 
noise at the output of the filter. 


Advanced Problems 


16. Think of representing a periodic 
discrete signal with the aid of a Fourier- 
Walsh transform in which the basis 
functions of the form exp( — j2nnk/N) used 
in the conventional discrete Fourier 
transform are replaced by Walsh functions. 

17. Propose a digital filtering procedure 
based on the direct use of the discrete and 
inverse discrete Fourier transforms. 

18. Using FORTRAN, write a fragment 
of the routine implementing the algorithm 
for recursive digital filtering. 

19. Using the method of invariant 
impulse responses, synthesize a digital filter 
corresponding to an analog lossy resonant 
circuit whose impulse response has the form 


h(t) = exp( — at)cos @ot 


20. In mathematics, a sequence of 
numbers related such that x; = x;— 1 + x;_> 
is called the Fibonacci sequence. Find the 
first ten Fibonacci numbers on setting xo = 
—0 and x,=1. Propose an analytic 
procedure for finding Fibonacci numbers of 
any order. Connect this problem to that of 
the stability of recursive digital filters. 


Chapter 16 
Optimum Linear Signal Filtering 


Noise and interference control and suppression are an important 
task in many branches of telecommunications. The high noise 
immunity of telecommunication systems can in principle be assured 
in two ways. One consists in improving the structure of the signals 
being transmitted. An example is offered by the Barker sequences 
examined in Chap. 3. The other consists in developing equipment 
capable of signal detection in noise. 

This chapter will be concerned with signal detection in noise by 
stationary linear systems acting as frequency filters. A frequency- 
selective system which processes the sum of a signal and noise in 
the best possible manner is called an optimum filter. 

The meaning that is implied in the concept of optimality varies 
among other things, according as the signal waveform is known in 
advance or not. If the signal waveform is known, an optimal filter is 
expected to detect the signal with a maximally attainable 
probability. If, on the other hand, the signal waveform is not 
known, an optimal filter must separate the signal from its mixture 
with noise as best as it can. In the latter case, an optimum filter is 
customarily taken as that which minimizes the root-mean-square 
error between the actual signal and the filter output. 


16.1 Optimum Linear Filtering of Known Signals 


The pages that follow will set forth the theory used to build 
linear optimum filters in both cases. 

The task of the optimum detection of a known signal in noise 
arises, for example, in radar. Here, the received signal s,(t) is an 
exact, scaled-down replica of the transmitted signal s;(t), that is 


s(t) = As{t — 1) (16.1) 


where A « 1. 

The received signal may be very small and comparable in 
amplitude with the effective noise voltage present at the receiver 
input. 

A radar receiver does two jobs: (a) it detects the signal, that is, it 
establishes the fact that the reflected signal (the target echo) is 
present in the received wave; and (b) it determines the delay time t, 
which is a measure of the distance to the target. 

A specific aspect in the operation of a radar is that in processing 
the received signal the signal waveform need not be retained. In 
fact, it is desired that in the course of processing the signal be 
transformed in such a way that its application to the filter input 
would produce at some instant an appreciable "spike" in the 


e 
The optimum filter 


u 

The difference between 
the detection of a 
known and an unknown 
signal waveform 


t 
0 

Signal *spikes" above 
the noise level 


488 


| 
The assumption that 
noise is Gaussian 


e 
The signal-to-noise ra- 
tio (SNR) 


psl 

The principle of filter 
optimality for a known 
signal waveform 


9 
The matched filter 


Part Two. Circuits 


instantaneous value of the output waveform. The noise present in 
the received waveform is usually Gaussian, so the probability that 
it, too, will give rise to noticeable "spikes" is negligible. Therefore, 
the appearance in the output waveform of a spike substantially 
exceeding the effective noise voltage indicates the presence of the 
signal at the receiver input with a high probability. 

The signalto-noise ratio at the output of a linear filter. We 
assume that the sum of the signal and noise is processed by 
a system which is a stationary linear filter whose frequency 
response is 


K (jo) = | K (jo) | exp [je  ()] 
The spectrum of a known signal sin(t) at the filter input is 
Sin(@) = | Sic) l exp [79 s(@)] 


Using spectral analysis, we can find the signal at the filter output 
at any time to 


Lh : 
Sout(t9) = = f |Sinl| Klexp[j(oto + 9s + ox)] do (16.2) 
Suppose that the noise accompanying the signal at the filter input 
is white noise for which the power spectrum W is the same at all 
frequencies. Then the variance of the noise at the filter output will 
be 


W, œ 
T — 0€ 


The ratio of the magnitude of the instantaneous value of the 
signal at time ty to the root-mean-square value of noise is known as 
the signal-to-noise ratio (SNR) at the filter output. Designating it as 
q and using Eqs. (16.2) and we get 








x* f [SalI eres es tao 
u Sout (to) ER 2n - o 


q= ES oo 
Sout W, " 1/2 
- K |* 
(x IN | à) 


An optimum filter will be one with Kopr(jo) which maximizes the 
signal-to-noise ratio at some time tọ. This form of optimum filter is 
also called the matched filter, because it is matched to a known 
signal. 

The frequency response of a matched filter. The task of finding 
Kopí(jo) is handled on the basis of the Cauchy-Buniakovsky 





(16.4) 








Ch. 16 Optimum Linear Signal Filtering 


inequality. By this inequality 

|| F1 (x) F3 (x) dx | < (f| Fy |? dx f| F3 |7 dx)" (16.5) 
for arbitrary functions F,(x) and F(x). In Eq. (16.5) the “equals” 
sign applies only when F,(x)=CF,(x), where C is a constant. 


From comparison of the left-hand side of (16.5) with the 
numerator of (16.4), let us put 


Fy (®) = | Sin | expos) (16.6) 


F* (o) — | K |exp[j (oto + 9x)] 


The numerator in (16.4) will be a maximum if F, and F, are 
proportional to each other, that is, 
| Sin| expos) = C| K| exp[ —j(@to + ox)] 

The equality of two complex numbers implies that their magni- 
tudes and arguments are respectively equal. In our case, 
| Sin] = CI K| 

(16.7) 

Os= —Oto — OK 

Hence, we immediately deduce the expression for the frequency 
response of a matched (optimum) filter 
Koplja) = B| Sin| exp( — jos) exp ( — joto) (16.8) 


where B=1/C is an arbitrary coefficient of proportionality. It is 
convenient to re-write Eq. (16.8) as 


Kopt(j@) = BSit (e) exp( — joto) (16.9) 








Thus, the frequency response of a matched filter is completely 
defined by the spectrum of the signal which the filter is intended to 
detect. The proportionality factor B in (16.9) determines the general 
level of gain due to the filter. The value of tọ only enters the 
expression for the phase response of the filter. From the general 
properties of the spectral representation of signals we know that the 
exponential factor exp (— j@tọ) is an indication that the filter 
response is shifted along the time axis by t,. 

Physical interpretation of the frequency response of the optimum 
filter. A filter intended to extract a known signal from a white noise 
mixture will pass the harmonic waves at the frequencies where the 
spectrum of the signal is nonzero. Also, naturally, the amplitude 
response of the filter will be proportional to the magnitude of the 
spectrum of the signal, that is, to the contribution that a particular 
frequency interval makes to the output signal. If the input signal 
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has a discrete spectrum (such as when the signal is periodic), the 
above principle leads to comb filters widely used in 
telecommunications. 

The matched filter whose behaviour is defined by Eq. (16.9) 
functions similarly to a comb filter. However, it assures a still high- 
er probability of signal detection because the phase characteristic 
of the signal spectrum is utilized to a better advantage. To 
demonstrate, the signal at the output of a matched filter 


B 7 A 
Sout(t) = 5- J Sin Sin exp [jo (t — t9)] do (16.10) 


is obviously, at an absolute maximum 


oO 
Sout,max = x J | Sin do = BE, (16.11) 
-— 00 
(where E, is the signal energy) at time tọ when all elementary 
spectral components of the input wave are combined at the output 
coherently, that is, in the same time phase. 

Thus, matched filtering calls for the maintenance of proper phase 
relations between the individual spectral components of the detected 
signal. 

The impulse response of a matched filter. If we know the fre- 
quency response of a matched filter, we can find its impulse 
response by taking the inverse Fourier transform of Eq. (16.9): 


1 oo 
h(t) oq J Kopi (jo) exp (jot) do 


= x 1 Si (o) exp[jo (t — to)] do (16.12) 


As will be recalled, any real signal has the property that Si&(c) = 


= Sin( — ©). Therefore, 


B > 
h=] Sin(— @) exp [jo (t — to)] do 


B'? 
RE On ] Sin (o) exp [jo (to EX )] deo’ 


= Bsin(tg — t) (16.13) 

Thus, we have proved that the impulse response of a matched 
filter is a scaled replica of the input signal, but this replica is 
a mirror image of the input signal on the time axis-this is 
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indicated by the "—" sign of t in Eq. (16.13). Also, the impulse 
response of the filter is shifted to the right, so it is delayed from the 
signal sin( — t) by to. 

The construction of the impulse response of the matched filter for 
a specific pulse signal sin(t) of finite duration is illustrated in 
Fig. 16.1. 








Fig. 16.1 Construction of the impulse response for a matched filter 


Referring to Fig. 16.1, we can formulate a necessary, but not 
a sufficient condition for the physical realizability of a matched 
filter: The time parameter ty defining the instant when the output 
signal has a maximal instantaneous value must be not less than the 
duration of detected signal. Otherwise, the impulse response of the 
system will be nonzero at t <0, that is, before the delta-impulse is 
applied to the filter input. 

The implication of the condition is this: If the output signal of an 
optimum filter is to have a maximally possible instantaneous value, 
the filter must utilize the energy of the entire input signal 

The waveform of the output signal of a matched filter. Suppose 
that a filter receives a noise-free signal sin(t) to which it is matched. 
Let us analyse the waveform of the output signal. To do this, we 
write on the basis of (16.10) 


B H 
Sout(f) x J | Sin() |? exp [jo (t — to)] do (16.14) 


Going back to Eq. (3.24) we can see that the output signal 
coincides to within the proportionality factor B with the 
autocorrelation function of the input signal, shifted backwards by 
to, that is, 





Sout(t) = BK(t — to) (16.15) 





As an example, Fig. 16.2 shows a plot of the signal at the output of 
some specific matched filter. 
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Fig. 162 Signal at the output of an optimum filter matched to 
a rectangular video pulse: (a) input signal; (b) its autocorrelation function; 
(c) output signal for ty)=Ttp, that is, when the output waveform is 
a maximum just as the input pulse ceases 


It is to be noted that in the case of optimum filtering the input 
and output signals may substantially differ in waveform. 

The signal-to-noise ratio at the output of an optimum filter. If 
the power spectrum of the white noise at the input of a filter with 
the frequency response of Eq. (16.9) is Wo, then the power spectrum 
of the output noise will be 


Wout(@) = Ws | Kop) |? = WB? | Sin(@) |? (16.16) 


The variance of the output noise is found by integrating 
Eq. (16.16) over all frequencies. It is connected to the energy of the 
input signal, Es, by a relation of the form 


W,B? f 
Sout = 2n | | Sin(®) |? do = WBE, 


J 


Hence, using the expression for the maximum response produced 
by the filter (see Eq. (16.11), we find the maximum attainable 
signal-to-noise ratio 
Qmax = | Sout, max|/Sout = VEs/Wo (16.17) 

It is important to stress that Eq. (16.17) establishes the 


fundamental limit of signal detectability by device: intended to 
detect known signals mixed with white noise of specified intensity. 














Example 16.1. The signal being detected is a rectangular radio 


pulse of amplitude V) and duration xy — 10 ps. The white noise at the 
filter input has the power spectral density Wo = 3 x 10718 V?s. Find 
the minimum value of V, at which the signal can still be detected, if 
the receiver reliably indicates the presence of the signal with 
a signal-to-noise ratio of q — 3. 

On the basis of (16.17), the required signal-to-noise ratio will be 
realized if the signal energy is E.— 9W,. Since for a rectangular 
radio pulse, E, = V3tp/2, then Vo, min= |/ 18W,/xp — 2.32 x 1076 V. 
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A remarkable property of matched filtering is that the 
probability of detecting a signal depends above all on the energy in 
the signal. Notably, we can always provide for the reliable detection 
of a signal with a very small amplitude, if we extend the duration of 
the pulse in a suitable manner. This will of course slow down the 
transmission of information over the channel. 


16.2 Implementation of Matched Filters 


From the above expressions for the frequency and impulse 
responses of a matched filter, it is possible to find the physical 
structure of a device intended for the optimal filtering of a known 
signal. Some of the procedures used in the synthesis are discussed 
below. 

The matched filter for a rectangular video pulse. Consider an 
elementary pulse signal sin(t) which is a rectangular video pulse of 
known duration tp and of an arbitrary amplitude V4. Our search 
for the structure of the filter matched to such a signal will be based 
on the spectral principle. To begin with, we find the spectrum of the 
signal at the filter input: 


x Tp 
Sin(®)= f sin(t)exp(—jot)dt = V, f exp( — jot) dt 
ac 0 


— (Vo/je) [1 — exp (— jotp)] (16.18) 


Hence, basing ourselves on Eq. (16.9), we find the frequency 
response of the matched filter by setting t; = tp, which means that 
the output of the filter is a maximum at the instant when the pulse 
ceases: 

. | — exp (jot e 
Kopt(i@) = pi 8 nk) api — j@Tp) 


= B(1/jo)[1 — exp( — joy] (16.19) 


The result thus obtained is sufficient for a matched filter to be 
synthesized. As follows from Eq. (16.19) this filter must be 
a cascaded connection of three linear elements: (a) a scaling 
amplifier with gain B, (b) an ideal integrator, and (c) a network 
with a frequency response, K(jo) = 1 — exp( — jotp) which can be 
implemented with a delay unit to delay the signal for time ty, an 
inverter to change the sign of the signal, and an adder. In 
block-diagram form, the filter thus synthesized is shown in 
Fig. 16.3. 


The matched filter for a train of identical video pulses. In radar 
the waveforms coming from the amplitude detector of the receiver 
are often combined into trains so as to build up the power in the 
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T 
s Inverter 


Fig. 16.3 Matched filter for a rectangular video pulse 


signal. Suppose that such a train consists of N identical video 
pulses of duration tp each; the spacing between the pulses is T. If 
So (©) is the spectrum of one pulse, then the spectrum of the train 
will be 


Slo) = So (1 te FF 4 e J20T. 4+ e -(N- NOT) (16.20) 


In synthesizing a matched filter for a pulse train, we require that 
the response be a maximum just as the last pulse in the train 
ceases. Hence, 


tg — (N — 1) T 1p 

By applying Eq. (16.9), we obtain the following expression for the 
frequency response of the optimum filter: 
Kop (jo) = BS$e 79 (1 + fT 4 2°74, 4 ejN- DoT) 

= Koop (ja) (1 +e 77 + eT 4. pe JUN VOT) 
(16.21) 

where Ko opt (jm) is the frequency response of the optimum filter for 
a single video pulse. 

The structure of the sought matched filter results directly from 


Eq. (16.21). In block-diagram form, it appears in Fig. 16.4. As is 
seen, a matched filter for a single video pulse is located at the input. 


(N-1)T 





L Output 


Fig. 16.4 Matched filter for a train of video pulses 
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The basis of the entire device is a multi-tap delay line which delays 
the signals for T, 2T, ..., and (N — 1) T. From all the taps, the 
signals go to the adder. It is an easy matter to see that the response 
at the adder output will be a maximum when the signals from all 
the pulses in the train are present at its inputs simultaneously. 

Thus, the above matched filter “compresses” the train by deriving 
a single response of a maximum amplitude from the entire sequence 
of pulses making up the train. The performance of the device 
improves with increasing length of the train. 

Practical radar detectors also include a nonlinear threshold 
element whose input is connected to the output of the adder in the 
matched filter. The threshold level somewhat exceeds the 
root-mean-square level of noise in the no-signal condition. When 
the maximum spike of the filter output signal reaches the threshold 
level, a control signal is routed to the display unit, thereby 
indicating the presence of the pulses reflected from a target. 

The matched filter for a rectangular radio pulse. Let the signal 
being detected be a rectangular radio pulse such that 


(o, t«0 
Si (t) =) Vosinaot, 0 < t & Tp (16.22) 
( 0, t> ty 


We set out to synthesize a filter matched to such a signal 
by using our knowledge about the impulse response of the filter. 
As has been shown earlier, the impulse response of a matched 
filter is 


h(t) — Bsin(to — 1) 


Let us put, as before, tọ = tp, and, deem for simplicity that the pulse 
duration is a multiple of the period of the r.f. carrier and so 
Sin WpTp= 0, and cos@ptp= 1. Then, 


0, t«0 
h(t)= Bsinogt, O<t<tp (16.23) 
0, t> Tp 


As is seen, the impulse response of a matched filter replicates the 
input signal to within the amplitude factor. This impulse response 
can be approximately realized with the structure shown in 
block-diagram form in Fig. 16.5. 

As is seen, at the filter input there is an oscillatory element, such 
as a high-Q resonant circuit whose impulse response is 


0, 
no=| 


Hsin of, 


t«0 
t>0 


where H is a constant. 
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Oscillatory section 






Delay unit Phase shifter 


Output 


Fig. 16.5 Matched filter for a rectangular radio pulse 


For the impulse response of the matched filter to be zero at t > 
> ty, the filter includes an adder one input of which receives the 
signal from the oscillatory element directly, and the other does so 
via a delay unit which delays the signal for tp. Connected in series 
with the delay unit is a phase shifter which reverses the phase of the 
signal. With this arrangement, the adder inputs receive, beginning 
at t = Tp, two harmonic waves which have the same amplitude, but 
are opposite in phase. The result is a zero signal at the adder 


output. 

The matched filter for Barker sequences. A matched filter can be 
far more effective in signal compression, if the input consists of 
Barker sequences instead of simple trains of pulses. As is pointed 
out in Chap. 3, an advantage of Barker sequences is that the main 
lobe of the autocorrelation function has a very high value, whereas 
the side lobes are minimal. 

A block diagram of a matched filter for M-digit Barker sequences 
is shown in Fig. 16.6. The filter utilizes the principle of phase-shift- 
keying in which, as will be recalled, the input signal consists of 
a sequence of chopped harmonic waves whose phase angles ,, q;, 
..., Ọm are either zero or 180° (see Fig. 3.7). 

In synthesizing this form of matched filter, we proceed from the 





Phase shifters 


Output 


Fig. 16.6 Matched filter for a Barker sequence 
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fact that its impulse response must be a “mirror image” of the 
detected signal, with its elements following in a reverse time order. 

At the input of the matched filter there is an auxiliary filter F, 
matched to one element of the complex PSK signal, that is, to 
a rectangular radio pulse. Under the action of the input 
delta-impulse, the filter output delivers a radio pulse with 
a rectangular envelope. This pulse is applied to a tapped delay line 
which usually is a distributed-parameter (wave) structure. The delay 
time between the taps is equal to the duration T of each element of 
the complex signal. 

For the matched filter to operate properly, it is essential that the 
sequence of phase angles Qa, Qy ,. ... q«, (Fig. 16.6) should 
correspond to the phase angles of the individual pulses of the 
Barker sequence as counted backwards. 

Travelling along the delay line, the rectangular radio pulse 
consecutively excites the inputs of the adder, and this delivers 
a "mirror image" of the signal being detected. 

The matched filter for LFM-pulses. Equation (16.17) tells us that 
the limiting value of the signal-to-noise ratio at the output of 
a matched filter depends on the energy in the signal, whatever its 
waveform may be. In practice, however, the task is usually not only 
to detect the presence of a signal, but also to measure some 
parameters of the signal, say its time position. In such cases, 
preference is given to signals whose autocorrelation function has 
a sharp maximum (see Chap. 3). 

Among the several signals possessing this property, those 
especially widely used are linearly frequency-modulated (LFM) 
pulses. Their theory is set forth in Chap. 4. It has been shown that 
if an LFM pulse of the form 


0, t< — 1/2 
Sig (t) =$ Vo cos (Wot + pt?/2), — 15/2 « t < 1/2 
lo, t> ty/2 


has a large bandwidth-duration product, pt> 1, then its 
spectrum Sin(@) = | in| exp [jẹ (v)] within the bandwidth Aw = ptp 
has a practically constant magnitude 


Sil = Vo 7/24 
and the argument is a quadratic function of frequency: 
(o) = — (o — @o)?/2u (16.24) 


Hence comes the requirements that should be satisfied by the 
frequency characteristic of the filter matched to an LFM-signal: 
For the output response to be a maximum at some time fo, it is 
essential that the amplitude response of the filter should be 
constant in the frequency interval (og — Aw/2, ©o + Aw/2) and that 
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its phase response should be 





Qk (@) = — Oty + (o — @p)”/2u (16.25) 





The first term on the right-hand side of Eq. (16.25) is responsible 
for the delay of the output signal as a whole for a time to, the 
second (quadratic) term compensates for the phase shifts between 
the individual components of the signal and thus assures that they 
are combined coherently at the output. 

The quadratic character of the phase response of the matched 
filer for an LFM signal can be deduced from the following 
qualitative considerations. In the course of the intrapulse 
modulation the instantaneous frequency of the signal varies linearly 
as 


a(t) = og + ut 


in the time interval ( — 15/2, 15/2). To each time t within the pulse 
duration there corresponds its own narrowband (quasiharmonic) 
signal which is delayed by the filter for the time interval equal to 
the group (envelope) delay time (see Chap. 8): 





T= —dox/do = ty — (© — eu = ty — t (16.26) 


In order to find the instant when the individual spectral 
components appear at the output, we should add to the above time 
the amount f, that is, the time when the spectral components 
appear at the input Hence we conclude that all the spectral 
components of the LFM signal appear at the filter output at the 
same time fo. 

The signal appearing at the output of the matched filter replicates 
to within an arbitrary amplitude factor A the autocorrelation 
function of the LFM pulse (see Eqs. (4.54) and (16.15)): 


T 
sin Peo — to) 
Sout = A ——————— cos &y (t — to) (16.27) 


T 
F - t) 


A plot of the above signal has been given in Fig. 4.10. It is easy to 
see that the width of the main lobe of such a signal, as measured 
between zero points, is equal to 


Tout = 41/A@ = 4T/UTp 


Therefore the compression ratio of an LFM pulse provided by the 
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matched filter 


bandwidth x duration 
K comp = tp/tout = utp/4n = dn (16.28) 











is directly proportional to the bandwidth-duration product of the 
LFM signal. 

In constructing actual matched filters, advantage is taken of 
a physical phenomenon consisting in that elastic ultrasonic waves 
propagating in solids display what is known as dispersion, that is, 
variations in the velocity of propagation with frequency. Through 
the proper choice of the form of dispersion, it is possible to secure 
that the phase response has the form defined in Eq. (16.24) In 
sketch form, the arrangement of such a filter is shown in Fig. 16.7. 


Input Output Tg 





l w 

Wo 

(5) 
Fig. 16.7 Distributed-parameter filter matched to an LEM signal: (a) 
sketch; (b) frequency dependence of group delay in the acoustic line; (1) 
acoustic line; (2) electromechanical tfansducers 


In contrast to the optimum filtering of trains of video pulses, the 
matched filtering of LFM pulses is usually effected at the carrier 
frequency or the intermediate frequency of the receiver, that is, 
ahead of the amplitude detector. This avoids the undesirable 
suppression of a weak signal by a strong interference which may 
arise when the sum of the signal and noise is subjected to nonlinear 
transformation. 

Quasi-optimum filters. In some cases, a known signal mixed with 
a Gaussian noise can be detected with sufficient effectiveness, using 
filters far simpler in design than optimum filters.. They are 
customarily called quasi-optimum filters. 

Consider an integrating RC two-port whose input simultaneously 
receives white noise of power spectrum W, and a rectangular video 
pulse of amplitude V, and duration tp. Since the two-port is 
a linear network, the passage of the signal may be considered 
separately from that of the noise. 

The output signal is a maximum at the instant when the pulse 
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ceases, and is equal to 
Sout, max = Vo [1 — exp( — Tp/RC)] 
On the other hand, the variance of the output noise of the 
RC-network driven by white noise is defined (see Chap. 10) by 
Sout = W,/2RC 
Hence, the maximum signal-to-noise ratio at the output of the 
RC-network is 

Vo[1 — exp( — tpRO)] 


q = 
Re VW, RC 


Noting that the energy in the video pulse in question is E;= 
=V tp, we may re-write (16.29) as follows: 





(16.29) 





“fe exp( — T,/RC) | 


(16.30) 
Vw2RC d 


anc = VEI 





The first factor on the right-hand side is the signal-to-noise ratio 
realized by the filter. The factor in the square brackets represents 
the degradation in the signal-to-noise ratio suffered by the RC-filter 
as compared with a true optimum filter. 

On introducing a dimensionless parameter x= tp/RC, let us 
consider the function representing the above factor: 


Ix) ac 16.31 
(x) , 7p ( ) 


Its plot appears in Fig. 16.8. As is seen, at x= 1.25, k(x) is at 
a maximum equal to 0.90. 














k 

0.9]- 

0.8 

0.6 

0.4 

0.2 -] 

x 

0 11.25 2 3 4 


Fig. 16.8 Impairment in the signal-to-noise ratio of an RC filter in 
comparison with a matched filter 


Ch. 16 Optimum Linear Signal Filtering 


Thus, through the proper choice of the time constant for the 
RC-network, it is possible to build a very simple quasi-optimum 
filter for which the signal-to-noise ratio is only 10% lower than it is 
for a matched filter. 

It should be noted that quasi-optimum filters of acceptable 
performance can be built only for relatively simple signals with 
a small bandwidth-duration product. 


16.3 Optimum Filtering of Random Signals 


In practice it is usual that the exact form of the signal is not 
known in advance. Examples are the real signals sent into the 
communication channel from sources such as a microphone, a TV 
camera, etc. In such cases, the instantaneous values of the signal 
should be treated as typical realizations of a stationary, ergodic 
ensemble, and the sole information about the entire set of likely 
signals is contained in the power spectrum (or the autocorrelation 
function) of this random process. 

In the channel, the signal is accompanied by noise. As a rule, the 
power spectra of the signal and of the noise differ to a varying 
degree in their position along the frequency axis. This difference can 
be utilized in order to formulate and solve the problem which has 
as its objective to develop a stationary linear filter which could 
detect the signal in the best possible manner. 

The statement of the problem and the criterion of optimality. 
Suppose that the input of a filter whose frequency response is K (jo) 
is fed simultaneously two random signals whose realizations are 
x(t) and z(t). Let x(t) be the wanted signal, and z(t) be the noise. 
Both are realizations of two stationary random processes, X (t) and 
Z(t), respectively. It is presumed that these two random processes 
are uncorrelated and are defined by their power spectra, W,.(@) and 
W.(a). 

The realization y(t) of the output signal of the filter is not an 
exact replica of the input signal x(t) but differs from it by an 
amount known as the random error 


e(t)  x(t) — y(t) (16.32) 


The optimum filter is then taken as that for which the error 
variance is a minimum. 
Relation of the error variance to the power spectrum. If W,(o) is 


the power spectrum of the error, then its variance is 
x 


o2=- W,(o) do (16.33) 


Let us relate We(@) to W,.(@) and W.(o). For this purpose, we will 
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Fig. 16.9 Explaining the derivation of the error signal 


consider the block diagram of an imaginary device whose output is 
the realization of the error, e(t), (Fig. 16.9). 

Since, by the statement of the problem, the processes X (t) and 
Z(t) are uncorrelated, the powers of the random signals reaching 
the output over each of the two available channels are combined, 
and so 


W.(@) = | K (ja) |* W.(@) + | 1 — K Go) |? Wo) (16.34) 


Let us write the frequency response of the filter in exponential 
form: 


K (jo) = Hy (o) exp jo (©) 

and investigate the term |1 — K (jo)|? on the right-hand side of 
Eq. (16.34). Obviously, 

|1 — K Ga) P = Hi — 2Hycosog + 1 


this quantity being a minimum when q, = 0. Thus, the optimum 
filter in question should introduce a zero phase shift at all 
frequencies. 

Noting this, we obtain the following expression for the error 
variance: 


s 
2x J 


2 


o= KH; — 1? W, + HEW] do (16.35) 


Minimization of the error variance. By carrying out simple 
identity transformations, it is convenient to write Eq. (16.35) as 


l - Wo \? WW; 
o? = — W+ W Hp- ——— | + ——*~— do 
tom IU Wet We) WtW, 


(16.36) 


The magnitude of the frequency response, H (o), appears only in 
the integrand term within the parentheses. This term is nonnegative, 
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therefore the error variance is a minimum when 


VW. + W.H, - 


Hence, 


W, (0) 
VW: + W, 


=0 





Hk, opt(@) = 


W;(@) + W-(o) 





(16.37) 


Equation (16.37) not only solves the problem stated, but also 
makes it possible to find on the basis of Eq. (16.36) the minimum 


error variance: 





ae ID (16.38) 


or, on passing from W, and W; to the one-sided power spectra Fx 


and F,, 


w 





2 F YF; 
Se, min = F +F,“ 
x Zz 


0 


ü 

Physical interpretation 
(16.39) of the frequency pro- 

perties of an optimum 

filter 


The meaning of the above results is simple: The amplitude 


response of 


optimum filter which minimizes the 


root-mean-square error must be large at the frequencies where the 
bulk of the signal energy is céncentrated. Conversely, it must 
decrease where the power spectrum of the error is high. 








Fx10  vinz! 





2.5 





Example 16.2. A random process X(t) (the wanted signal) has 
a band-limited one-sided power spectrum Fx equal to 5x 10 9 
V? Hz”! in the frequency band from 1 to 3 kHz and zero elsewhere. 
The random process Z (t) (the noise) has a one-sided power spectrum 
showing a similar frequency dependence: F,=2.5 x 10 95 V?Hz ! 
in the frequency band from 2 to 4 kHz. Find the frequency response of 
the optimum filter and the minimum root-mean-square error in the 
signal reproduced. 

Taking advantage of Eq. (16.37), we find that the amplitude 
response of the optimum filter must be nonzero only in the fre- 
quency interval 1-3 kHz where the power spectrum of the detected 
signal is concentrated, such that 

( 1, 1 kHz <f < 2 kHz 


H =} 
kop 10,66, 2kHz«f«3kHz 
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The signal variance equal to the product of the power spectrum 
by the frequency band occupied, is 


oł=5 x 1076 x 2x 10° 210-7? V? 0.66 


On the other hand, from Eq. (16.39) we get 


2 


Oe, min = 
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H k, opt 
1.00}- 





12.5 x 107 1? 


355 107% x 10° = 1.66 x 107? V? 012 3 4 





To sum up, when the two above random processes are subjected 
to linear filtering, the root-mean-square error in the signal 
reproduced will be at least 16.6%. 





Summary 


$33 $F $ 


A matched filter intended to detect a known signal mixed with Gaussian white noise 
at a maximum signal-to-noise ratio must have a frequency response proportional to 
the complex conjugate spectrum of the signal. 

The impulse response of a matched filter is a “mirror image” of the detected signal. 
The response of a matched filter to the signal being detected is proportional to the 
time-shifted autocorrelation function of the signal. 

The maximum attainable signal-to-noise ratio at the output of a linear filter depends 
only on the signal energy and the power spectrum of the noise. 

Satisfactory results in the detection of simple signals can be obtained by using quasi- 
optimum filters instead of matched filters. 

For a linear filter to detect a random signal with a minimum root-mean-square error, 
its amplitude response must be a maximum in the frequency band where the power 
spectrum of the signal is high, and it must be a minimum where the power spectrum 
of the noise is high. 


Review Questions 


1. What is the difference between the criterion of optimality for filters used for the detection 
of known and unknown signals? 

2. Explain the principle of coherent addition of spectral components in the case of matched 
linear filtering. What is the difference between the comb filter and the matched filter? 

3. State the condition for the delay time tọ when a known signal is detected by an optimum 
filter. 

4. What autocorrelation function of a signal should be like so that a matched filter could 
detect it effectively? 


nun 


What principle underlies the construction of real matched filters for LFM pulses? 
. What is the relation of the minimum error variance to the power spectra of the signal 


and of the noise in the optimum filtering of a random signal? 


Ch. 16 Optimum Linear Signal Filtering 


Problems 


1. Plot the impulse response of the filter 
matched to the triangular input signal 
shown below: 





0 Tp 

Give the minimum value of delay time tọ. 

2. A resistor R = 500 Q held at T = 300 K 
acts as an equivalent source of white noise 
at the input of a filter. What should the 
resultant signal energy be for the matched 
filter to give a signal-to-noise ratio of q = 5? 

3. A PSK Barker sequence consists of 13 
pulses, each pulse being 10 pV in amplitude 
and 5us in duration Find the power 
spectrum of the input white noise at which 
the output signal-to-noise ratio is unity. 


4. There is an LFM pulse with 
a rectangular envelope, a frequency 
deviation of Ao —3x10's ! and 


a duration of 15 —3.5 x 10? s. Find the 
duration of the main lobe of the wave at the 
output of the filter matched to this signal. 
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5. The signal is a realization of a random 
process X (t) for which the one-sided power 
spectrum is Fx=8 x 1075 V?Hz ^! in the 
frequency band 0< f< 300 Hz, and zero 
elsewhere. This signal is combined with 
white noise, Z(t), whose one-sided power 
spectrum is F-—2x 1076 V? Hz ^! at all 
frequencies. Find the error variance in the 
signal detected by an optimum filter. 


Advanced Problems 


6. Draw a block diagram for the matched 
filter intended for the optimum detection of 
a triangular signal (see Problem 1). 

7. Contemplate the possibility of reducing 
the side lobes of the  autocorrelation 
function of an LFM signal by using time 
variations in frequency more complex than 
linear. 

8. Derive an equation defining the fre- 
quency response of an optimum filter which 
can predict the instantaneous values of the 
signal x(t-- tg) that is, extrapolate some 
"future" values of the signal in the best 
possible manner (in the mean-square sense). 


Appendices 


Appendix 1 Walsh Functions and Some 
of Their Properties 


At present, several methods are in use for determining Walsh 
functions [22]. The most convenient way is one based on the 
recurrence relation 


wal(2n + p, 8) 2 ( — 107?1* PT wal (n, 29 + 1/2) 
* (— 1" * Pwal(n, 29 — 1/2] n=0, 1, 2, ... (ALI) 


Here [n/2] stands for the largest integer number, which is smaller 
than or equal to n/2; the number p may take on values 0 or 1. 
In carrying out iterations, it should be remembered that the 
function wal(0,9) is constant over the interval —1/2«8 « 1/2: 


0, $< — 1/2 
wal (0, 9) = 1, —1/2«8«1/2 (A1.2) 
0, $>1/2 
For example, on setting n — 0 and p— 1, we obtain from (A1.1) 
wal(1,$)= — wal(0,29 + 1/2) — wal(0, 29 — 1/2) 
The Walsh functions have an interesting property: 
wal (m, 9) wal (n, 9) = wal (1, 8) (A1.3) 
where the index / is the modulo 2 sum of the indexes m and 
n (symbolized as 1 2 man). In order to take a modulo 2 sum, the 
numbers m and n must be expressed in binary notation; then the 


binary numbers are added together without a carry to the next 
more significant bit position by the following rule: 


160=0@1 =1 (A1.4) 
0@0=1@1=0 

For example, if m = 5 (dec.) = 101 (binary) and n = 6 (dec.) = 110 
(binary) then 1016110 — 011 (binary) —3 (dec.) Thus, 
wal(5, 9) wal(6, 9) 2 wal(3, 9) 

In the literature on the subject, in addition to the Walsh 
functions, use is often made of two more related systems, namely 
the even functions cal(n, 9) (similar to cosines) and the odd 


fucntions sal(n, 9) (similar to sines) The three classes of functions 
are related in the following manner: 


cal (n, 9) = wal (2n, 9) (A1.5) 
sal(n, 9) = wal(2n — 1, 9) 
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Appendix 2 Berg Functions yo(9), yi(9), and y2(9) 


Appendix 3 The Subroutine for the Computation of 
Berg Functions 


SUBROUTINE BERG (N, T, G) 

PI = 3.1415926 

A=N 

IF (N. EQ. 0) GOTO 1 

IF (N. EQ. 1) GOTO 2 

G —2. «(SIN(A + T) « COS (T) — A + COS 
«(As T) SIN(T(PI« A «(A * A — 1.) 
RETURN 

1 G = (SIN (T) - T«COS(T)/PI 
RETURN 

2 G-(T-SIN(T)«COS(T)/PI 
RETURN 
END 


This subroutine is called out with the CALL BERG (a, P, Y) 
statement. Here a and f are the actual values of the harmonic 
number n and the cutoff angle 9, respectively. The computed values 


66,97 


of the function y,($) are stored in the "y" memory location. 
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Appendices 


Appendix 4 Laplace Transform Pairs 





F(p) 


p/(p + a) 
ae +a)] 
1/(p + a)(p + b) 


p/(p + a)(p +b) 


1/(p + a}? 
p/(p +a} 
w/(p? + o?) 
p/(p? + o?) 
oy [(p +.a)* +07] 
(p 4- ay/[(p +a vo] 
pip? — a?) 
a*/p? (p +a) 
1 
p(p+a)(p+b) 
1 
pP [(p 4 ay +@7] 
l 
(p + a)(p? + 07) 
-nb oo 
(p + a) (p? + e?) 
p 
(p + a) (p? + e?) 


f() 








ò (t) 
c (t) 
t 
exp (— at) 
6 (t) — aexp( — at) 
1 — exp(— at) 
1 





e | sinot 
e "cosot 
cosh at 


at —(1—e ^) 





J 1+ l (be^ ^ — ae ^J] 
ab a—b 


= a. 
z [1— € “(cos ot + — sin ot)] 
[o 


a +o 
l 

a? +o? 
1 


— (ae " — aw sina t + w cos ot) 


Fu a . 
(° — cos Qt + — sino t) 
o 


> (- ae “+ acosmt +osinot) 
a rto 


Appendices 


Appendix 5 The Subroutine for the Computation 
of Discrete Fourier Coefficients 


SUBROUTINE TRFUR (X, A, B, N, G) 
DIMENSION X(N), A(N), B(N) 
G=0. 

A1 — 0. 

AN-N 

DOII=1,N 

G=G+X() 


A1=Al -(—1)**I*X(I) 
G — G/AN 
A(N/2) = Al/AN 
M=N/2-1 
DO2I = 1,M 
AI-I 
A(I) = 0. 
B(I) = 0. 
DO3J = 1,N 
AJ —J 
T = 6.283185 + AI * AJ/AN 
C=COS(T) 
S = SIN (T) 
AM=A(I)+X(J)*C 
A(I) 2 A(D - X()*C 

3 B(D-B(D-X()*S 
A (I) = A(D*2./AN 

2 B(D-B(I)*«2/AN 
RETURN t 
END 


The arguments of the above array are as follows: X, the real 
array of numbers being processed; A and B, the arrays of real and 
imaginary parts of the discrete Fourier transform, respectively; N, 
the length of the input array; G, the name of the variable 
corresponding to the constant component of the discrete Fourier 
transform. Some of the memory locations assigned to arrays À and 
B remain vacant, which is permitted if the length of the array being 
processed does not exceed several tens of samples. 
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Index 


ABCD matrix, 391 
Admittance, 
driving-point, 259 
input, 259 
AM detector, 
diode, 335 
Amplification, 
parametric, 352, 360 
Amplifier, 
bandwidth of, 237 


dynamic transfer characteristic of, 324 


nonlinear tuned, 323 
operational, 420 
parametric, 358 
double-stage, 361 
small-signal, 236 
tuned, 264 
tuned, 413 
feedback in, 413 
Amplitude detector, 147 
Amplitude modulation, 103, 330 
multitone, 107 
single-tone, 105 
Amplitude response, 229 
Amplitude spectral density, 50 
Amplitude spectrum, 50 
Analog integrator, 423 
Analog-to-digital converter, 462 
Analysis, 
frequency-domain, 239 
phase-plane, 442 
spectral, 239 
Analytic signal, 149 
spectrum of, 151 
Angle modulation, 112 
Angle modulation index, 115 
Approximation, 
Butterworth, 395 
Chebyshev, 395, 399 
equal-ripple, 395 
exponential, 318 
maximally flat, 395 
piecewise-linear, 316 
power, 317 


Attenuation, 397 
Autocorrelation function, 85, 179 
discrete signals, 91 
LFM signals, 127 
narrowband random process, 203 
quantization noise, 483 
random signals, 190, 291 
relation to power spectrum, 90 
white noise, 195 
zero-crossings of, 294 
Autocovariance function, 179 


Band-limited signals, 
orthogonal, 136 
Bandpass filters, 
implementation of, 405 
Bandwidth, 56 
amplifier, 237 
angle-modulated signal, 120 
half-power, 238 
noise, 298 
pulse, 56 
Bandwidth-duration product, 142 
Barker sequences, 95 
cross-correlation function of, 99 
Basis, 27 
Kotelnikov, 138 
linearly independent, 27 
orthonormal, 33, 137 
Berg functions, 507 
Bridge networks, 393 
Broadband signals, 268 
Butterworth approximation, 395 


Canonic networks, 390 

Carrier, 13, 18, 103 

Cauchy’s residue theorem, 241 
Cauer ladder networks, 387 
Cavity resonators, 222 
Characteristic equation, 233, 381 
Characteristic function, 169 
Characteristic impedance, 259 


Chebyshev approximation, 395, 399 
Chebyshev polynomials, 399 
Circuit analysis, 380 
Circuit synthesis, 380 
Circuit theory, 380 
Circuits, 13 

parametric, 345 

response of, 345 
zero memory, 345 

with feedback, 409 
Coding, 

amplitude, 92 

phase, 92 
Collector detector, 333 
Comb filter, 489 

amplitude response of, 489 

signal spectrum of, 489 
Complementary function, 233 
Complex frequency, 67 
Complex input admittance, 259 
Complex input impedance, 261 
Complex p-plane, 382 
Complex response, 228 
Complex spectral density, 50 
Continued fraction expansion, 387 
Continuity, 196 
Convergence, 196 
Conversion transconductance, 349 
Converter, 

analog-to-digital, 462 

digital-to-analog, 463 
Convolution, 62 

discrete, 457 

z-transform of, 462 
Correlation, 172 

delta, 190 
Correlation analysis, 78, 84 
Correlation coefficient, 172, 180, 297 
Correlation detector, 183 
Correlation time, 90, 91, 194 
Correlator, 183 
Covariance, 172 
Covariant moment, 172 
Cross-correlation, 183 
Cross-correlation function, 96, 183 

Barker sequences, 99 

discrete signals, 99 

relation to cross-power spectrum, 98 
Cross-correlation moments, 172 
Cross-covariance function, 183 
Cross-energy, 31, 78 
Cross-power density spectrum, 80 
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Cross-power spectrum, 80 
Cross-spectral density, 80 
Crossing problem, 201 
Crossings, 

Gaussian processes, 202 
Cut-off angle, 45 
Cut-off frequency, 395 


Darlington's theorem, 390 
Decay time, 18 
Delay, 
envelope, 285 
group, 285 
Delayed feedback, 414 
Delta correlation, 190 
Deita function, 23, 223 
filtering properties of, 25 
Laplace transform of, 71, 254 
spectrum of, 56 
Demodulation, 13 
Demodulator, 147 
synchronous, 351 
Depth of modulation, 104 
Detection, 13 
AM signals, 330 
linear, 334 
square-law, 334 
synchronous, 350 
Detector, 
diode AM, 335 
envelope, 335 
linear, 335 
synchronous, 351 
Differentiating networks, 244 
Digital filtering, 448 
algorithms, 468 
Digital filters, 462 
canonic form of, 474 
effect of quantization on, 482 
frequency response of, 466, 471 
implementation of, 466 
impulse response of, 465, 470 
linear stationary, 462 
order of, 469 
recursive, 472 
signal quantization in, 463 
stability of, 474 
synthesis of, 477, 479 
system function of, 467 
transversal, 469 
vs. recursive, 478 
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Digital resonator, 480 
Digital signal processor, 463 
Digital-to-analog converter, 463 
Digitization, 

periodic signals, 453 
Diode AM detector, 335 
Dirac delta function, 23 
Discrete signals, 448 

cross-correlation function of, 99 
Distribution, 

Gaussian, 166 

normal, 166 

Poisson, 304 

Rayleigh, 209 

bivariate, 212 

Rice, 214 

uniform, 166 
Distribution function, 164 
Down-converter, 361 
Driving function, 222 
Driving-point admittance, 259 
Driving-point immitance, 385 
Driving-point impedance, 261, 380, 391 

real and imaginary parts, 383 
Duhamel superposition integral, 223, 240 
Dynamic transconductance, 315 
Dynamic transfer characteristic, 324 


Eigenfunction, 227 
Eigenvalue, 227 
Energy density, 82 
Envelope, 18 
Envelope delay, 285 
Equal-ripple approximation, 395, 399 
Ergodicity, 181 
Estimate, 
empirical, 163 
sample, 163 
Excitation, 222 
Expectation, 165, 179 
Expected value, 165 
Exponential approximation, 318 


Fall time, 18 
Fast Fourier transform, 457 
Feedback, 
degenerative, 410 
delayed, 414 
internal, 432 


Index 


negative, 410 
positive, 410 
in tuned amplifier, 413 
regenerative, 410 
Feedback element, 409 
Feedback networks, 415 
Filter synthesis, 420 
Filtering, 
digital, 448 
optimal, 487 
random signals, 501 
Filters, 
active RC, 420 
Butterworth, 396 
comb, 489 
digital, 448, 462 
frequency, 80 
Gaussian radio, 267 
high-pass, 81 
ideal bandpass, 267 
ideal low-pass, 230 
ideal quadratic, 152 
implementation of, 401 
low-pass, 134, 423 
matched, 488 
maximally flat, 396 
optimum, 487 
order of, 396 
prototype, 406 
quasi-optimum, 499 
Fluctuations, 162 
Forcing function, 222 
Forward-path element, 409 
Foster type networks, 387 
Foster’s theorem, 385 
Fourier integral, 240 
Fourier series, 42, 453 
generalized, 33 
Fourier transform, 49, 50 
basic properties of, 57 
discrete, 453 
inverse, 456 
fast, 457 
inverse, 51 
discrete, 456 
of impulse response, 371 
relation to Laplace transform, 69 
relation to z-transform, 461 
Frequency, 
complex, 67 
cutoff, 238, 395 
fundamental, 43 


idler, 361 

instantaneous, 114 

intermediate, 348 

negative, 47 

reference, 143 

resonance, 369 
Frequency changer, 348 
Frequency conversion, 348 
Frequency converter, 348 


Frequency deviation-pulse duration product, 126 


Frequency division multiplexing, 111 
Frequency filter, 80 
Frequency limit, 238 
Frequency modulation, 114 
Frequency multiplier, 325 
Frequency response, 227, 235, 240 
compensation of, 412 
digital filters, 466, 471 
isolation networks, 401 
multistage system, 242 


nonstationary dynamic system, 170 


parallel resonant circuit, 261 

parametric network, 371 

relation to impulse response, 228 

series resonant circuit, 259 
Frequency response function, 261 
Frequency transformation, 405 
Function, 

autocorrelation, 85, 179 

autocovariance, 179 

characteristic, 169 

complementary, 233 

cross-correlation, 96 

delta, 23, 223 

spectrum of, 56 

Dirac delta, 23 

distribution, 164 

driving, 222 

forcing, 222 

frequency response, 261 

Green, 223 

Heaviside, 21, 71 

moment, 179 

positive real (p.r.), 382 

rational, 235 

response, 228 

step, 23 

switching, 21 

spectrum of, 64 

system, 228 

transfer, 249 

unit impulse, 23 
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voltage-ratio transfer, 391 
Functions, 

Berg, 507 

Walsh, 34, 506 
Fundamental frequency, 43 


Gain, 

closed-loop, 410 

negative, 243 

overall with feedback, 410 
Gain factor, 237 
Gain stabilization, 411 
Gaussian distribution, 166 
Gaussian radio filter, 267 
Green function, 223 
Group delay, 285 
Gyrators, 425 


Harmonic suppression, 411 
Harmonics, 43 
HEAVISIDE, O, 249 
Heaviside function, 21 
Laplace transform of, 71 
High-pass filter, 81 
Hilbert integral transform pair, 383 
Hilbert space, 31 
real, 31 
Hilbert transform, 149, 152 
Hilbert transform pair, 153 
Hurwitz polynomials, 416 


Ideal bandpass filter, 267 
Ideal integrator, 200 
Ideal low-pass filter, 230 
Ideal quadratic filter, 152 
Idler circuit, 361 
Idler frequency, 361 
Immitance, 
driving-point, 385 
Impedance, 
characteristic, 259 
driving-point, 262, 380, 391 
input, 261 
transfer, 391 
Impulse response, 223, 252 
computation of, 240 
digital filters, 465, 470 
Fourier transform of, 371 
frequency-selective circuits, 268 
matched filter, 490 
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516 Index 


nonstationary dynamic system, 370 Markov processes, 184 
relation to frequency response, 228 Markovian chain, 185 
Information, 15 Matched filter, 488 
Information theory, 15 for Barker sequences, 496 
Instantaneous frequency, 114 frequency response of, 488, 490 
Integral, implementation of, 493 
Duhamel superposition, 240 phase response of, 498 
Fourier, 240 Mathematic signal model, 15 
Integrating networks, 244 Matrix notation, 391 
Intermediate frequency, 348 Maximally flat approximation, 395 
Intermodulation products, 122, 328 Mean, 165, 179 
Internal feedback, 432 Mean square, 165 
Isolation networks, 401 Message, 15 
Inverse Laplace transform, 69 Metric, 29 
Inverse z-transform, 460 Metric space, 29 
Minimum-phase networks, 392 
: Mixer, 348 
Keying, 108 Modulation, 13, 103 
on-off, 108 amplitude, 103, 330 
phase-shift, 280 angle, 112 
Kotelnikov basis; 138 double-sideband, 110 
Kotelnikov series, 138 frequency, 114 
Kotelnikov theorem, 137, 455 phase, 113 
KOTELNIKOV V.A., 137 pulse, 448 


pulse-am plitude, 449 

pulse-width, 449 

single-sideband, 111 
Moment functions, 179 
Moments, 165 

central, 166 

correlation, 172 

cross-correlation, 172 
Miltiplexing, 

frequency division, 111 

time division, 19 


Ladder networks, 386 
Cauer, 387 
Laplace inversion formula, 250 
Laplace transform, 67, 248 
basic properties of, 71 
delta impulse, 254 
inverse, 69 
relation to Fourier transform, 69 
relation to z-transform, 461 
Laplace transform pairs, 70, 252 
Laser, 432 
Lattice networks, 393 


Law of Equipartition of Energy, 301 : 
Limit cycles, 443 Hilbert transform of, 154 


Linear circuits, Network functions, 391 
synthesis of, 380 Network synthesis, 386 
by Cauer method, 388 
by continued-fraction expansion, 388 


Narrowband signals, 143 


Linear detection, 334 
Linear digital filters, 


synthesis of, 477 by 'divide and invert the remainder pro- 
Linear signal space, 26 cess, 388 
Local oscillator, 348 by Foster method, 387 
Loss, 243 by partial fraction expansion, 387 
Low-pass filter, 395, 423 Networks, 


active, 409 

active RC, 421 
Magnitude response, 229 bridge, 393 
Manley-Rowe relations, 364 canonic, 390 


Cauer ladder, 387 
Foster-type, 387 
four-terminal, 314, 391 
isolation, 401 
ladder, 386 
lattice, 393 
minimum-impedance, 383 
minimum-phase, 392 
nonminimum-phase, 392 
with feedback, 409 
Noise, 

antenna, 302 
power spectrum of, 301 
quantization, 483 
quantum, 162 
shot, 304 
signal suppression by, 335 
thermal, 301 
white, 195 

response to, 294 


Noise bandwidth, 298 

Noise immunity, 13 

Nonlinear distortion, 322 

Nonlinear signal transformations, 313 
zero-memory, 313 

Nonlinear tuned amplifier, 323 

Nonminimum-phase networks, 392 

Nonperiodic signals, 49 

Norm of signal, 28 

Nyquist law, 301 

Nyquist locus, 418 

Nyquist stability criterion, 418 « 


One-port, 380 
On-off keying, 108 
Operating angle, 45 
Operational amplifier, 420 
Operational calculus, 249 
Operational method, 248 
Optimum filtering, 

random signals, 501 
Orthogonal signals, 32 
Orthonormal basis, 33, 137 
Oscillators, 426 

Colpits, 430 

Hartley, 428 

large-signal condition, 435 

local, 348 

phase portrait of, 443 

pump, 352 

RC phase-shift, 430 

self-excitation of, 426 


Index 


small-signal condition, 426 
steady-state operation, 437 
three-terminal, 428 
tranformer-coupled, 426 


Paley-Wiener criterion, 229 
Parametric amplification, 352, 360 
Parametric amplifier, 358 
double-stage, 361 
Parametric network, 
frequency response of, 371 
Parametric up-conversion, 365 
Parseval’s relation, 79 


Partial fraction expansion method, 387 


Particular integral, 233 

Periodic signals, 42 
digitization of, 453 
spectral diagrams of, 44 

Phase deviation, 113 

Phase modulation, 113, 448 

Phase plane, 442 

Phase plane analysis, 442 

Phase plane method, 442 

Phase portrait, 442 

Phase response, 229 

Phase trajectory, 442 


Piecewise-linear approximation, 316, 319 


Poisson distribution, 304 
Pole-zero diagram, 250 
Pole-zero representation, 250, 263 
Poles, 

location of, 380 

number of, 382 
Positive real function, 382 
Power approximation, 317 
Power density, 82 
Power density spectrum, 82, 191 
Power spectral density, 82, 191 

random processes, 292 
Power spectrum, 81, 190 

noise, 301 

one-sided, 192 

random processes, 292 

random signals, 291 


relation to autocorrelation function, 90 


shot noise, 308 
Probabilistic laws, 162 
Probability, 163 
Probability density, 164 

bivariate, 178 

one-dimensional, 178 
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two-dimensional, 178 stationary, 179 
univariate, 178 Gaussian, 184 
Prototype filter, 406 narrow-sense, 180 
Pulse, power spectrum of, 292 
amplitude of, 18 wide-sense, 180 
bandwidth of, 56 Rational function, 235 
duration of, 18 RAYLEIGH, Lord, 79 
fall time of, 18 Rayleigh distribution, 209 
radio, 18 bivariate, 212 
spectrum of, 65 Rayleigh formula, 
rise time of, 18 generalized, 78 
video, 18 Rayleigh-Jeans radiation formula, 302 
Pulse-amplitude modulation, 449 Recursive digital filters, 472 
Pulse duty factor, 44 Resistance, 
Pulse modulation, 448 d.c., 314 
Pulse modulator, 448 dynamic, 315 
Pulse-width modulation, 449 incremental, 315 
Pump oscillator, 352 Resonance curve, 262 


Resonance frequency, 
instantaneous, 369 


Q-factor, 260 Resonant cavity, 222 

Quadrant symmetry, 395 Resonant circuit, 

Quantization, capacitance-tunable, 368 
effect on digital filters, 482 Response, 

Quantization interval, 464 amplitude, 229 

Quantization noise, 464, 483 Butterworth, 396 
autocorrelation function of, 483 complex, 228 

Quantized signals, 464 free, 233 

Quantum noise, 162 frequency, 235, 240 


impulse, 223 
magnitude, 229 


Radiation resistance, 303 maximally flat, 396 

Radio pulse, 18 phase, 229 
spectrum of, 65 transfer, 228 

Ramp input, 245 transient, 233 

Random signals, 162 Response function, 228 
autocorrelation function of, 291 Rice distribution, 214 
broadband, response to, 298 Ripple factor, 399 
normalization of, 300 Rise time, 18, 278 
optimum filtering of, 501 Routh-Hurwitz criterion, 416 


power spectrum of, 291 
stationary, response to, 337 


Random processes, 177 Sample, 448 
correlation theory of, 189 Sampling, 448 
differentiation of, 196 Sampling mterval, 19, 449 
effective bandwidth of, 195 Sampling rate, 451 
integration of, 196 Sampling theorem, 137, 455 
Markov, 184 Scale changer, 422 
narrowband, 203 Schematic circuit diagram, 222 

autocorrelation function of, 203 Schottky’s equation, 307 

power spectrum of, 190 Secular factors, 233 


spectral representation of, 189 SHANNON, C., 15, 143 
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Shot noise, 304 Single-sideband modulation, 111 
power spectrum of, 308 Singular points, 70 

Sideband, 108 Small-signal amplifier, 236, 264 
double, 110 Space, 
lower, 108 completeness of, 37 
upper, 108 Hilbert, 31 


infinite-dimensional, 27 
linear normed, 27 
linear signal, 26 


Signal energy, 28 
Signal space, 26 
Signal suppression, 335 


Signals, 15 metric, 29 

AM, detection of, 330 Spectral density, 82, 191 

amplitude modulated, 103 Spectrum, 42, 50 

analog, 19 analytic signal, 151 

analytic, 149 complex exponential signal, 63 

band-limited, 133 delta function, 56 
mathematical models of, 133 exponential video pulse, 53 
orthogonal, 136 Gaussian video pulse, 54 

bandwidth-duration product of, 142 radio pulse, 65 

broadband, 268 rectangular video pulse, 53 

classification of, 15 switching function, 64 

continuous, 19 time-shifted signal, 58 

correlation analysis of, 84 translation of, 66 

cross-energy of, 31, 78 Spectrum analyzer, 273 

deterministic, 17 Square-law detection, 334 

digital, 19 Standard deviation, 166 

discrete, 19, 448 Step function, 23 
autocorrelation function of, 91 Step input, 245 

dynamic representation of, 20 Step response, 252, 254 

ideal bandpass, 134 STRUTT, J.W., 79 

ideal low-pass, 133 Superheterodyne receiver, 349 

mathematical model of, 16 Superposition principle, 221, 313 

modulated, 103 » Switching function, 21 

multidimensional, 16 spectrum of, 64 

narrowband, 143 Synchronous demodulator, 350 
Hilbert trasform of, 154 Synchronous detection, 350 

nonintegrable, 62 Synchronous detector, 351 

nonperiodic, 49 Synthesis, 

norm of, 28 active RC networks, 421 

one-dimensional, 16 digital filters, 479 

orthogonal, 30, 32 linear circuits, 380 

periodic, 42 linear digital filters, 477 
digitization of, 453 network, 386 

power spectra of, 78, 81 passive one-ports, 385 

pulsed FM, 122 reactive one-ports, 387 

quantization in digital filters, 463 System function, 228 

quantized, 464 digital filter, 467 

random, 17, 162 Systems, 219 

sampled, 19 autocorrelation characteristic of, 248 

scalar product of, 31 distributed-constant, 222 

spectral representation of, 42 dynamic, 230 

stochastic, 17 frequency response of, 370 


vector, 17 impulse response of, 370 
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nonstationary, 366 Laplace, 67, 248 

order of, 231 inverse, 69 

stability of, 238 properties of, 71 

transient response of, 233 z-, 458 
linear, 221 Transmission matrix, 391 
lumped-constant, 222 Two-ports, 314, 380 
mathematical models of, 220 frequency characteristics of, 391 
nonlinear, 221 transfer function of, 392 


nonstationary, 220 
operators of, 219 


parametric, 220 Uniform distribution, 166 
response of, 219 Unit impulse function, 23 
stationary, 220 Unit impulse input, 223 
time-variant, 220 Unit step input, 223 
with feedback, 410 Up-converter, 361, 365 
Tapped parallel resonant circuit, 263 Variance, 166 
Time constant, 231 Varindor, 358 
_ of tuned circuit, 270 Voltage-ratio transfer function, 391 
Time division multiplexing, 19 forward. 392 
Time-domain approach, 240 isolation networks, 401 
Transconductance, reverse, 392 ? 


conversion, 349 
dynamic, 315 


M o Walsh functions, 34, 506 
: White noise, 195 


linear feedback system, 409 autocorrelation function of, 195 
location of poles, 392 
response to, 294 


location of zeros, 392 : um 

maximally-flat (Butterworth) filter, 397 Wiener-K hinchin theorem, 191 
poles of, 250 

RC networks, 424 


system, 249 Zero-crossings, 294 
two-ports, 392 autocorrelation function, 294 
zeros of, 250 Zeros, 
Transfer impedance, 391 location of, 380 
Transfer matrix, 391 number of, 382 
Transfer response, 228 z-Transform, 458 
Transform, of continuous function, 460 
Fourier, 49, 50 inverse, 460 
discrete, 453 properties of, 461 
inverse, 51 relation to Fourier transform, 461 
properties of, 57 relation to Laplace transform, 461 


Hilbert, 149, 152, 153 of time-shifted signal, 461 


